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[57] ABSTRACT 

A software system which allows a guide/specialist to interact 
with a client on a real-time, interactive basis over the World 
Wide Web. The methodology includes configuring a guide 
system with a special-purpose browser displaying bot h 
l ocally displayable frames and remotely displavable frames : 
the client system utilizes a cojjyentional browser. The 
remotely displayable frames are transmrne^ToTEe^cirent so 
that both th e guide and the client have identical views oLt he 
re motely displayable frames. The guide uses the locally 
displayable frames to call upon av ailable Web resourc es. 
ty pically in response to a client request also tra nsmitted nvpr 
th e Web v ia, for example, a chat program , and then the guide 
canToad the re motely displavable frames into the re motely 
di splayable frames for rendering by the convent ional 
b rowser. In addition, the guid e and client can intera rtwith 
a shared pointer and a shared~whiteboar d. MoreoverTthe 
gui de.canjcecord the^ve session for later playharW by other 
clients. Also, a plurality of clients may be simultaneously 
intera cting with the ffuide and each othe r. 

20 Claims, 38 Drawing Sheets 
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CLIENT OR GUIDE SELECTS 
A LINK TO TERMINAL SESSION 



-3002 



SESSION PROGRAM CONTACTS 
PIPER SERVER AND ISSUES 
TERMINATE COMMAND 



-3004 



PIPER SERVER DELETES 
ALL RESOURCES ASSOCIATED 
WITH SESSION NAME 
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FIG. 31 



GUIDE SELECTS A TERMINATE LINK k" 3102 
TO REMOVE CLIENT FROM SESSION 



I 



SESSION PROGRAM CONTACTS M 104 
PIPER SERVER AND ISSUES 
COMMAND TO REMOVE CLIENT 



I 



PIPER SERVER LOCATES CLIENT BY M 106 
IP ADDRESS AND PORT NUMBER. 
AND DELETES COMMUNICATION 
CHANNEL AND RESOURCES 
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FIG. 32 



GUIDE SELECTS "ENUMERATE" LINK k~ 3202 

r 

SESSION CONTACT P IPER SERVER [ ^ 3204 



^ ^ ^3206 



PIPER SERVER RETURNS 
LIST OF ALL SESSIONS 



I 



SESSION PROGRAM PRINTS OUT 
LIST OF ALL SESSIONS IN HTML 
PAGE VIEWABLE BY GUIDE 
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FIG. 33 

— /s ■ 

Session(l) .htm 

<HTML><HEAD>< t i 1 1 e> Active Piper Sessions</title></HEAD> 
<B0DY> 

<h2>Active Piper Sessions</h2><p> 
Sess i o n : 0EFAU[T_vpc24_2 1570<a 

HREF= " htt p : / / vpc24 . bel lcore . cora/Hamel i n/cgi-bi n/session. exe?JOINS*DEFA 
ULT_vpc24_21570">--«Join»— </a><a 

HREF= " http : / / vpc24 . bellcore . cora/Hamel i n/cgi-b i n/session . exe?A- JOINS+OE 
Mm j FAULT.vpc.21570'>"«ACTIVE-RAT-J0IN»— </a> 
3302s < a HREF="http://vpc24. bellcore. com/Hamelin/cgi-bin/session.exe?LISTCLI 
ENTS*localhost+DEFAULT_vpc24 21570">«LIST 
CLIENTS»</a><a 

HHEF='http://vpc24. bellcore. com/Hainelin/cgi-bin/session.exe?KILLSESSIO 
N+locaLhost»OEFAULT_vpc24 21570">«REM0VE 
SESSI0NS»</a><a> 
Session:PCHELP_vpc24_21655<a 

HREF= "http : / / vpc24 . bellcore . cora/Hameli n/cgi-bi n/session. exe?J0INS*PCHE 
LP_vpc24_21655">- -«J0IN»- - -</ a><a 

HREF="http://vpc24. bellcore. com/Hamelin/cgi-bin/session.exe?A-JOINS+PC 
m J HELP.vpc24.21B55">--«ACTIVE-RAT-J0IN»— </a>< 
3JU ^ a HREF=*http://vpc24. bellcore. com/Hamelin/cgi-bin/session.exe?LISTCLIE 
NTS* 1 ocal host +PCHELP_vpc24 21655*>«LIST 
CLIENTS»</a><a 

HREF= "http : / / vpc24 . bellcore. com/Hamelin/cgi-bin/session.exe?KILLSESSIO 
N+localhost*PCHELP_vpc24.21655">«REM0VE 
Session»</a><p> 
</B0DY></HTML> 



\ 
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FIG. 34 



CLIENT CLICKS ON LINK 
REQUESTING "LIST CLIENTS' 

I 

SESSION PROGRAM CONTACTS 
PIPER SERVER AND ISSUES 
COMMAND TO "LIST CLIENTS" 

1 

PIPER SERVER RETURNS LIST 
OF CLIENTS TO SESSION PROGRAM 

I 

SESSION PROGRAM RETURNS 
HTML-FORMATTED LIST 
OF CLIENTS 
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FIG. 35 



CLIENT LOADS WEB PAGE 
DESCRIBING SESSION 
(SESSION.EXE? FRAME+APPLET+JOIN) 



I 



CLIENT-SIDE COMPONENT CONNECTS 
TO PIPER SEHVER SPECIFYING 
SESSION NAME 



I 



PIPER SERVER LOCATES SESSION 



I 



PIPER SERVER SENDS SEQUENCE OF 
FRAMESET LOAD, PAGE LOAD STEPS 
TO CLIENT-SIDE COMPONENT TO 
SYNCHRONIZE PAGE WITH GUIDE SYSTEM 
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FIG. 36 



GUIDE SELECTS MENU ITEM 
TO SHOW I HIDE) POINTER 



I 



DIRECTOR APPLICATION SHOWS 
(HIDES) POINTER 



I 



DIRECTOR SENDS 'POINTER ON" 
("POINTER OFF") WGP-COMHAND 
TO PIPER SERVER 



I 



PIPER SERVER SENDS WGP-COHMAND 
TO EACH CLIENT 



I 



EACH CLIENT SHOWS (HIDES) POINTER 
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FIG. 37 



THE GUIDE OR CLIENT CLICKS ON 
POINTER AND DRAGS POINTER 



I 



THE LOCAL POINTER MOVES AS DRAGGED 

1 



GUIDE SYSTEM OR CLIENT SYSTEM 
SENDS THE WGP-COMMAND 
"POINTER MOVE X V WHERE 
X.Y IS THE NEW POSITION 



I 



PIPER SERVER SENDS SAME WGP- 
COMMAND TO ALL CONNECTED CLIENTS 



I 



EACH CLIENT SYSTEM OF GUIDE 
SYSTEM MOVES THE POINTER 
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FIG. 38 



GUIOE SELECTS A MENU ITEM 
TO SHOW (HIDE) WHITEBOARD 



I 



DIRECTOR APPLICATION CONSTRUCTS 
WHITEBOARD (NOW TRANSPARENT) 
ON TOP OF LOCAL PREVIEW 



I 



DIRECTOR APPLICATION SENDS 
"WHITEBOARD ON" ("WHITEBOARD OFF") 
COMMAND TO PIPER SERVER 



I 



PIPER SERVER SENDS APPROPRIATE "ON* 
("OFF") COMMAND TO EACH CLIENT SYSTEM 



I 



EACH CLIENT SYSTEM ENABLES 
(DISABLES) THE WHITEBOARD 
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FIG. 39 



GUIDE OR CLIENT CLICKS AND DRAGS 
MOUSE TO DRAW A LINE 



WHITEBOARD ORAWS LINE FOLLOWING 
HOUSE POINTER ON TOP OF 
UNDERLYING WEB PAGE 



I 



WHEN MOUSE BUTTON IS RELEASED, 
DIRECTOR APPLICATION OF CLIENT-SIDE 
COMPONENT SENDS THE WGP- COMMAND 
"LINE.COLOR 3 NX1Y1X2Y2* 
TO PIPER SERVER 



I 



PIPER SERVER FORWARDS THIS WGP- 
COMMAND TO ALL CLIENT SYSTEMS 



I 



EACH CLIENT SYSTEM DRAWS 
THE LINE SEGMENTS ON 
DISPLAY USING BROWSER 
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SYSTEM AND METHOD FOR MANAGING 
INTERACTIONS BETWEEN USERS IN A 

BROWSER-BASED 
TELECOMMUNICATIONS NETWORK 

FIELD OF THE INVENTION 

This invention relates to a browser-based telecommuni- 
cations network such as the Internet and, more particularly, 
to a system and method for managing interactions between 
users in the browser-based telecommunications network. 

BACKGROUND OF THE INVENTION 

With the advent of the Internet, the communication of 
knowledge and information has altered dramatically. The 
coalescing of telecommunications with computers, espe- 
cially personal computers (PCs), has allowed for the essen- 
tially instantaneous propagation of and/or exchanging of 
data and resources among users/collaborators on a world- 
wide basis. 

The Internet, probably the most widely recognized inter- 
connection network deployed today, is a loosely-coupled 
arrangement of networks that interconnects hundreds of 
thousands of PC systems, supercomputers, mainframes, 
workstations, laptops, and even pocket radios throughout the 
world. A pictorial representation of the Internet is shown in 
FIG. 1; this representation is one which is particularly 
instructive in the context of the present invention. As rep- 
resented in FIG. 1, Internet 101 is a packet-oriented, con- 
nectionless (as distinct from circuit-switched) network of 
computers and telecommunication links. Exposed for view 
are certain components comprising Internet 101 at any 
instant, namely, PCs 102 and 103 as well as computers 104 
and 105. Communication paths 111-114 to Internet 101, 
which couple PCs 102-103 and computers 104-105, 
respectively, to Internet 101, propagate packets using the 
standard TCP/IP protocol. Also shown are ports 121 and 122 
which serve as the "entry points" into Internet 101 from PCs 
101 and 102, respectively. A port allows for on-demand, 
non-permanent connection into Internet 101. On the other 
hand, computers 103 and 104 are shown as being perma- 
nently connected to (that is, part of) Internet 101. 

Information available on the Internet is termed Internet 
Resources, and this term will be used to encompass text, 
video (such as movie clips, cartoons, interviews with 
people), images (such as famous paintings and pictures), 
sound (such as excerpts from speeches, music and promo- 
tional materials from corporations), databases (large collec- 
tions of information such as electronic texts, encyclopedias, 
and dictionaries), documents (business and financial 
information, government documents such as Internal Rev- 
enue Service (IRS) forms), applications programs and inter- 
active games. The integration of text, graphics, sound and/or 
video is known as multimedia. 

About 1992, the World Wide Web (WWW, W3, or Web) 
was developed as a tool for locating and accessing the 
Internet Resources. The WWW is "hypertext" based. Hyper- 
text is a database format that is a way of managing infor- 
mation that allows items of information to be connected 
using associative links. A hypertext database is composed of 
a number of Internet Resources that can be represented on a 
user's display screen (say a screen associated with PC 102). 
The Internet Resources are connected by links (also known 
as hyperlinks) which are also represented on the display 
screen. Links can be text based (words) or icons (pictures or 
symbols). For a PC system user to access the Internet 
Resources, the user follows links on the display screen by, 
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for example, pointing and clicking a pointing device (such 
as a "mouse") or alternatively by hitting a key on the 
keyboard. 

The basic building block of the WWW is a Web page 
5 which contains the Internet Resources and links. Web pages 
are written in HyperText Markup Language (HTML) which 
is a methodology for marking up documents with informa- 
tional tags that indicate how the Internet Resources should 
be presented and how the Internet Resources are linked 
!0 together. Each Web page has a unique address known as a 
Uniform Resource Locator (URL). By analogy, just as 
person can be located by street address, Internet Resources 
and Web pages can be located by their unique URLs. 
A Web site is a collection of Web pages maintained by an 
15 entity such as a college, university, government agency, 
company or individual. Web pages and web sites are linked 
together via telecommunications networks and communica- 
tion paths using various physical transmission media to form 
the WWW. It is often helpful to visualize the Internet as a 
20 multimedia hyperlinked database that spans the world. 

The computers on the Internet communicate using the 
Transmission Control Protocol/Internet Protocol (TCP/IP), 
as alluded to with reference to FIG. 1. The TCP/IP protocol 
25 describes how information is propagated throughout the 
Internet. TCP/IP breaks the information into packets, routes 
those packets from the sending computer to the receiving 
computer and finally reassembles the packets once the 
packets reach the receiving computer. Oftentimes the TCP/ 
3Q IP protocol forms the basis for a higher-level protocol, which 
may be user-defined, as required. 

Moreover, the reliability offered by TCP/IP is very useful 
and many other programs and/or open protocols are built on 
top of it. One such protocol is the HyperText Transfer 
35 Protocol (HTTP), a protocol designed for the rapid and 
efficient delivery of hypertext. Web pages and web sites are 
stored on computers known as Web servers or HTTP servers 
which are computers connected to the Internet that make 
Web pages and Web sites available to the world. ^—~> 
40 The HTTP servers or Web servers communicate using the 
HTTP protocol. The user's PC system establishes commu- 
nication with the HTTP server, requests to view Web pages, 
and the HTTP server responds to these requests by sending 
information such as Web pages and/or Internet Resources to 
4 5 the user's PC system. The user's PC system continuously 
displays the information received from the HTTP server 
while it responds to user's key strokes or mouse input. Once 
the HTTP server has delivered the requested information to 
the user, the HTTP server retains no memory of the event 
5 0 that just took place. 

The most widely used method for a home -based Internet 
user to access the Internet from his/her home is to connect 
to an Internet Service Provider (ISP), that is, an on-fine 
service provider, using a PC system (e.g., PC 102) that 
55 includes a high-speed modem and communications software 
to dial-in to the ISP. The ISP provides the access port (e.g., 
port 121) for the dial-up user. In contrast, users in a 
commercial environment are typically part of the company's 
LAN and have a direct connection to the Internet. The 
60 pictorial representation of FIG. 2 summarizes the dial-in 
mode of interconnection; this mode is addressed by the 
present invention. ISP 201 typically deploys server-based 
computer 202 forming part of Internet 101; computer 202 
may serve as the HTTP server for PC 102. 
65 Typically, after the user completes a logon procedure, the 
user is then able to invoke a so-called Web-based browser 
and a default home page (initial Web page) accessed by the 
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browser appears on the display screen. The WWW is acces- 
sible through the browser which is a program designed 
specifically for reading HTML of Web pages. When 
requested by the user's PC system, the HTTP server trans- 
mits the HTML directly to the browser. The browser usually 
has a graphical user interface (GUI) that displays the infor- 
mation in a graphical form or text only on the user's PC 
system. 

The browser enables the user to not only access Web 
pages, but also to follow links, create bookmarks (saved 
URL addresses used to mark Web pages or Web sites that the 
user wants to revisit), and maintains a history list (allows the 
user to return to any Web page or Web site recently visited). 
Two conventional browsers are Netscape Navigator and 
Microsoft Internet Explorer. 

The GUI of the browser allows the user to pick 
commands, start programs, and view documents or other 
options by selecting from windows, icons, links, and menus 
on the display screen. For example, a user can type queries 
(i.e. words or phrases) into search engines, follow ideas from 
one document to another using links, type a URL in the 
location bar and hit the enter key, select an item from one of 
a series of menus located on the browser (such as select a 
bookmark or select a Web site or Web page from the history 
list). 

FIG. 3 depicts a conventional browser, namely, the 
Netscape Navigator, showing the Web page for Yahoo, Inc. 
Several menus for the Netscape Navigator are shown in FIG. 
3. A menu is a on-screen list of available options and 
commands. Menu row 301 shows, for example, File menu 
302, Edit menu 304, and so forth. These menus allow the 
user to open a new browser, open a file, and access a 
bookmark among other things. The menus also provide 
access to electronic mail (e-mail) which is a feature that 
allows the user to send messages and/or documents to a user 
of another computer as well as receive messages and/or 
documents. 

As an alternative to menus, buttons can be selected for 
added functionality. Button rows 311 include, for example, 
the Back button 312 (to go back to the previous Web page 
or another Web page in the history list), Forward button 314 
(to go forward in the history list), and so forth. Selecting 
these buttons can show Internet Resources, provide addi- 
tional Web sites, or access a search engine to search the Web 
for phrases or a person's telephone number and/or address. 

There is one window 350 (a rectangular area on the 
display screen used to hold information relating to a par- 
ticular aspect of the browser currently in operation) which 
holds the Web page. Links on the Web page that are words 
include, for example, Arts & Humanities 322 through to 
Society and Culture 324. When these links are selected, 
Internet Resources are displayed or alternatively another 
Web page with more links is shown. 

Location bar 332 of the browser contains the URL of the 
current Web page displayed. In this instance, the URL is 
"http://www.yahoo.com". Title bar 342 contains the name of 
the Web page currently being accessed; the page in FIG. 3 
is entitled "Yahoo". This Web page also contains search 
engine 352. Yahoo is one of the available search engines 
which allows the user to type in a few words or phrases to 
be located. The search engine attempts to locate other Web 
pages related to the chosen words or phrases. The search 
engine will list the other related Web pages and the user can 
view these Web pages if interested. 

Several features are available for added sophistication 
using the Web. For example, "frames" are a convenient 
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mechanism for displaying more than one Web page in a 
browser. The browser can be split into parts which can be 
scrolled (move from the top of the page to the bottom of the 
page) individually. Each part of the display is called a frame. 

5 Different Web pages can be displayed in each frame. 
Alternatively, a hst of categories (i.e. a tree of resources or 
table of contents) can be shown in one frame and the 
contents (set of links) in the other frame. Conventionally, the 
arrangement of the frames is static or fixed and set forth by 
0 the HTML of the Web pages. In FIG. 3, there is one frame 
in the browser and this frame contains the Web page for 
Yahoo as fixed by the designer of the Yahoo page. 

A Web page can also contain other Internet Resources 
such as "applets", "plugins", and scripting language. All of 

15 these technologies add intelligence and interactivity to Web 
pages and support a greater range of functionality. An applet 
is a (small) application program that typically is stored on 
the Web server. The applet is downloaded (i.e. transfers from 
the Web server to the user's PC system) with the HTML of 

20 the Web page when a Web page is requested by the user. 
Once the applet is downloaded, it is activated and runs on the 
user's PC system. A common language for writing applets is 
the Java programming language, a language that allows Web 
masters (i.e. people who design Web pages) to create ani- 

25 mated and interactive Web pages. 

A plugin is a software program that performs a task that 
a Web browser cannot perform on its own. A plugin exploits 
the fully programmable power of the browser and extends 
the capabilities of the browser in a specific way such as 

30 providing the ability to play audio samples or view video 
movies on the browser display. Plugins work in connection 
with the browsers and allow users to see video and 
animation, hear sound, and run programs in their previously 
graphics- and text-bound Web pages. If the browser called 

35 Microsoft Internet Explorer is being used then the ActiveX 
technology is used to create ActiveX controls, which offer 
similar functionality to plugins. 

As an alternative or supplement to an applet, plugin, and 
ActiveX control, scripting language can be utilized. Script- 

40 ing commands are embedded in the HTML which forms the 
Web page. When a browser requests such a Web page, the 
Web server sends the full content of the document including 
HTML and scripting commands over the network to the 
user's PC system. When the HTML is transferred from the 

45 Web server to the user's PC system, the browser on the 
user's PC system then converts the HTML into a Web page, 
and executes the scripting commands producing the results 
the user sees. Scripting commands embedded in a document 
containing HTML can respond to user events such as 

50 mouse-clicks, form input, and commands to load and unload 
Web pages. When used in conjunction with a plugin or 
applet, the scripting language can be used to make the plugin 
or applet run a feature or program when the user selects a 
button on the display screen. A common scripting languages 

55 is JavaScript. 

Another powerful facility for extending the functionality" 
of the WWW is the ability to execute arbitrary programs on 
the HTTP server in response to user requests. The Common 
Gateway Interface (CGI) is the specified standard for inter- 

60 facing these external applications with HTTP servers. "Cgi- 
bin" programs are executed in real-time so that dynamic 
information can be generated and displayed. A cgi-bin 
program can be written in any programming language. 
Cgi-bin programs are often used to process user input. A 

65 common example of a cgi-bin program is a search engine 
which processes a user request to search the Web for certain 
words or phrases. 
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One traditional use of the Internet has been to support software. This can be a complex task for an infrequent or 

real-time interpersonal communications. This class of appli- new user of the Web. All of these collaborative tools are not 

cations includes Internet telephony (allows people to com- very extensible (i.e. plugins, ActiveX controls, and scripting 

municate using voice over the Internet), and Internet video language cannot be utilized to extend their functionality) 

packages (Internet telephony with video), and collaborative « IT f . t , u . 4 . f „ 

tools (allows people to work together even though they are Unfortunately, since collaborative tools are not generally 

located physically apart). These tools were primarily devel- inte S rated wth the WWW, either navigating 

oped for the Internet before the advent of the WWW and are me Web or * n &&ng in a collaborative conference (two or 

currently being adapted for use on the WWW. more users usin S collaborative tools) outside the Web. For a 

^Collaborative tools have been developed to increase the n col ! ab °rative conference, a shared resource (i.e. shared 

level of interaction between users in a telecommunications whiteboard, shared pointer, distributed pasteboard, etc.) 

network. One such tool is a "chat program" which. includes which is not on the Web is used as an information exchange 

talk chat, voice chat, and video chat. Talk chat is a program medium. One drawback to using collaborative tools outside 

that allows two or more users of computers to comm unicate °f tne Web ^ tnat typically a user is required to pre-install 

b y typing their remarks back and forth wit hout exiting their mem which is often difficult for the casual user of a PC 

display screen. Voice chat allows users to hear the voice of 15 svste m. Another drawback is that the collaborative tools 

family, friends, colleagues, and any other people they wish mostly operate outside the Web as a separate application 

to hear. Video chat enables the user to see another user while which is a disincentive to use. 

- communicating. There are also drawbacks to navigation of the WWW 

Videoconferencing is another collaborative tool which 2Q today since navigation is predominately self -guided. As 

comprises holding a conference among users at remote previously mentioned, several methods of navigation on the 

locations by means of transmitted video and audio signals WWW are currently available. A user can type queries (i.e. 

via video and audio links respectively. The computers used words or phrases) into search engines, follow ideas from one 

for videoconferencing must have at least a camera, micro- document to another using links, type in a URL in the 

phone and earphones or speakers and videoconferencing location bar and hit the enter key, select an item from one of 

software. 2 a series of menus located on the browser (such as select a 

r ^Shared pointer and distributed pasteboard are collabora- bookmark or select a Web site or Web page from the history 

tive tools that will be seen simultaneously by a group of ^st). 

users in a telecommunications network. With respect to the These methods of navigation are flexible and easy to use, 

shared pointer, any user can move this pointer. Features of 30 hut do not reflect all the ways that people have traditionally 

a shared pointer such as color, size, shape, and visibility can communicated and acquired information. People normally 

be altered by any user, and all other users see the changes to communicate by talking to each other, engaging in a two- 

their pointer. The distributed pasteboard allows two or more way conversation often with one person asking questions of 

users to edit a document containing text and/or graphics the other if the person requires further information to make 

simultaneously using a collaborative document editor or 3S a decision. In particular, for the interactions between a 

other editing facilities. expert and a novice or a teacher and a class of students, the 

Another collaborative tool is a whiteboard. A whiteboar d expert and teacher typically provide information and/or 

is a shared workspace that two or more users can use to answer questions posed to them. 

exchange notes and diagrams. A digital whiteboard is the Close examination of the expert/novice and teacher/class 

direct electronic equivalent of a chalkboard or whiteboard, 40 relationship on the Web exposes deficiencies since these 

except that generally the people (i.e. users) who are using the relationships are poorly represented on the Web. As an 

whiteboard are physically in different parts of a building or example of a novice asking questions of an expert, consider 

world. A whiteboard permits a group of users to establish a business advertising on the WWW. Users can search 

communication that allows all of the users to see or modify information provided by the business and place orders from 

the whiteboard on their display screen. Whiteboards typi- 45 their PC systems. However, sometimes users require per- 

cally provide users with simple drawing tools like pens, sonal assistance. Some users are unable to find the desired 

geometric shapes (i.e. circles, squares, etc.), and allows product on the Web site or alternatively have questions 

users to import pictures. The color and width of the pen can regarding a product that they need to ask a knowledgeable 

be adjusted and freehand drawing is supported. Whenever customer representative to solve their problems and address 

the user modifies the display screen by adding text or 50 their needs. 

graphics, all other users see the changes immediately on The WWW docs not satisfactorily support the two-way 
their respective whiteboard. Users can use the whiteboard to interaction between people critical for these cases. As a 
make presentations or work collaboratively on a picture or result, fallback solutions normally adopted are (a) a tele- 
document, phone number to call for personal assistance; (b) an elec- 
To date, the attempts to integrate collaborative tools into 55 tronic form that must be filled in that is sent to the business 
the Web have produced mixed results. Collaborative tools setting forth details and then responded to by the customer 
such as shared whiteboards, shared pointers, and distributed representative; or (c) an e-mail address is given to send 
pasteboards have not effectively been incorporated into the questions to the business. 

Web. Although chat programs and videoconferencing have There are problems associated with these fallback solu- 

been applied to the Web (i.e. by embedding them in the 6 0 tions. In the first case the user must go off-line (i.e. leave the 

HTML of a Web page), they cannot be used flexibly. For PC system). It is often time consuming to telephone for 

instance, a chat program can be invoked and placed in a personal assistance because this often requires selecting 

frame of a Web page when a Web page is visited, but cannot from numerous options from a voice menu using the user's 

be started when needed under the control of one or more telephone or voice. Often, several minutes transpire before 

users without leaving the page. 6S the user is in contact with a human customer service 

Regarding videoconferencing, a user typically is required representative. In the second two cases, the interaction is no 

to download additional application programs to run the longer real-time. It can take hours, even days, for a user to 
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receive a response from the business. As a result of the 
above-mentioned drawbacks, users often attempt to find a 
competitor's Web site to search for a suitable product to 
meet their needs. The results are a loss of revenue to the 
business owning the Web page initially visited by the user. 5 
Thus, a need exists to provide the user with a real-time 
on-line interaction with a person (such as a customer 
representative). 

As a second example consider educational training in a 
classroom setting. Traditional classroom learning is effective 10 
due to the teacher having access to a wide variety of 
resources. Viewgraphs, pictures, video and audio recordings, 
and a whiteboard/chalkboard is utilized. These resources can 
be easily accessed and used flexibly during the teacher's 
lesson. Students can ask questions during or after the pre- 15 
sentation. The WWW does not currently support the func- 
tions required to promote effective learning in a traditional 
classroom setting. In particular, the ability to teach lessons 
interactively is not available on the WWW today. Thus, a 
need exists for a system and method to provide real-time 20 
interactive learning on the WWW. 

Another drawback when perusing the Web is that many 
Web sites are complicated to navigate. Thus, there exists a 
need for a practical technique for providing a user with an 
overview of the key features of a Web site while minimizing 25 
frustration to the user due to the learning curve. 

Very recently, research efforts have been devoted to 
alleviating the foregoing shortcomings and limitations. Rep- 
resentative of these efforts is the system developed by 3Q 
eFusion, Inc. of Beaverton, Oreg. The eBridge™ Interactive 
Web Response system delivers Internet-enabled consumers 
directly to call center agents — without the need for a 
callback — where they can talk and browse over a single 
phone line. However, while an agent and consumer are 35 
directly connected, the agent lacks the real utility to answer 
frequently asked questions fast and effectively. The agent 
and consumer view the same Web information on their 
individual displays, so that whatever the agent displays, the 
consumer also views, and vice versa. Thus, the displays of ^ 
the agent and consumer are synchronized and the displays 
are essentially identical. This mode of operation precludes 
the agent from accessing and viewing resources privately/ 
locally, on an interim basis, during the process of choosing 
the best information to display to the consumer. Thus, while 45 
it may take the agent tens of seconds or more to access and 
download a series of Web pages to provide an answer to a 
consumer question, the consumer is viewing the answer- 
seeking process without any real knowledge of what the 
agent is attempting to accomplish. 5Q 

The art is generally devoid of teachings or suggestions for 
displaying information common to both the agent and the 
consumer while also providing a local display area for the 
agent to locally select/display information, with the facility 
for the agent to then propagate locally displayed information 55 
to the consumer under control of the agent for display by the 
consumer. 

SUMMARY OF THE INVENTION 

The shortcomings of the prior art are obviated by a 60 
method of managing interactions between users in a 
browser-based telecommunications network so that, while 
synchronized, a guide and client (e.g., an agent and 
consumer) each may view separately displayed information. 

In accordance with the broad aspect of the present 65 
invention, a method for communicating between a guide 
system and a client system interconnected via a browser- 
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based telecommunications network, with the client system 
deploying a conventional browser, includes: (a) configuring 
the guide system with a special-purpose browser for dis- 
playing both locally displayable frames and remotely dis- 
playable frames on the guide system; and (b) under control 
of the guide, propagating the remotely displayable frames 
over the network to the client system for display by the 
conventional browser of the client system. 

Other aspects of the present invention which utilize the 
basic methodology set forth in steps (a) and (b) above as the 
underlying methodology include: 

(i) configuring both the guide system and the client 
system with jointly operational shared pointer software, 
and executing the shared pointer software to control a 
shared pointer displayable concurrently on the conven- 
tional browser and on one of the remotely displayable 
frames of the special purpose browser; 

(ii) configuring both the guide system and the client 
system with jointly operational whiteboard software, 
and executing the whiteboard software to control 
whiteboard markings displayable concurrently on the 
conventional browser and on one of the remotely 
displayable frames of the special purpose browser; 

(iii) configuring both the guide system and the client 
system with jointly operational free-hand drawing 
software, and executing the drawing software to control 
free-hand drawing markings displayable concurrently 
on the conventional browser and on one of the remotely 
displayable frames of the special purpose browser; 

(iv) configuring both the guide system and the client 
system administration software for identifying the cli- 
ent system, and executing the administration software 
to provide the identity of the client system to the guide 
system as rendered on its special purpose browser; 

(v) configuring both the guide system and the client 
system with administration software for disconnecting 
the client system from the guide system, and executing 
the administration software to disconnect the client 
system under control of the guide system; 

(vi) configuring the guide system with recording software 
for recording actions by the guide while using the guide 
system, and executing the recording software to record 
the actions; 

(vii) configuring the guide system with playback software 
for playing back the recorded actions of the guide, and 
executing the playback software, under control of 
either the guide or client, for display by the remotely 
displayable frames on the conventional browser; and 

(viii) configuring the guide system with editing software 
for editing the recorded actions of the guide, and 
executing the editing software, under control of either 
the guide, to edit the recorded actions of the guide. 

In addition, in accordance with another aspect of the 
present invention, a method for communicating between a 
guide system and a client system interconnected via a 
browser-based telecommunications network, with the client 
system deploying a conventional browser, includes: (a) 
configuring the guide system with a special-purpose browser 
for displaying both locally displayable frames and remotely 
displayable frames on the guide system; (b) configuring the 
guide system with a set of frame layouts; and (c) under 
control of the guide, propagating a selected frame layout 
along with the remotely displayable frames displayable 
using the frame layout over the network to the client system 
for display by the conventional browser of the client system. 

Moreover, the methodology is easily scaleable so that a 
plurality of client systems may interact with the guide 
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system, and each client system displays identical remotely FIG. 26 is a flow diagram explaining the steps taken by 

displayable frames. the piper server when JOINS command is invoked; 

BRIEF DESCRIPTION OF THE DRAWINGS F,G 27 fe a flow **S ra J°£*P lainin S the steps taken by 

the piper server when CREATE command is invoked; 

The invention will be more readily understood by refer- 5 FIG. 28 is a flow diagram explaining the steps taken by 

ence to the following detailed description taken in conjunc- the piper server when LOAD command is invoked; 

tion with the accompanying drawings wherein: FIG. 29 is a flow diagram that depicts how a client leaves 

FIG. 1 is a pictorial representation of the Internet with a session and the necessary steps taken to remove the client 

certain users and computers pertinent to the present inven- 1Q from the session using the DROP command; 

tion explicitly shown; FIG. 30 a flow diagram that depicts how a session is 

FIG. 2 depicts one illustrative method for accessing the terminated; 

Internet using an Internet Service Provider (ISP); F IG. 31 * a flow diagram that depicts how a cliem fa 

FIG. 3 depicts one illustrative embodiment of a browser removed from a session; 

which renders a Web page; 15 FIG. 32 is a flow diagram that illustrates the piper server 

FIGS. 4A-4M shows several embodiments of predefined querying for all active sessions; 

frame layouts; FIG. 33 is sample HTML produced by process block 3308 

FIG. 5 is a high- level block diagram depicting the inter- of FIG. 32; 

relationship betweerTthe piperlerver, sessions, guides, and ^ FIG. 34 is a flow diagram that illustrates the steps taken 

clicnts; when a query to list all clients for a session is issued; 

FIG. 6 is one illustrative embodiment of a Hamelin link FIG. 36 is a flow diagram illustrating the steps taken to 

which the client selects to initiate a session with a guide; j om the session; 

FIG. 7 shows one illustrative embodiment of the Hamelin FIGS. 37 and 38 show the actions taken by the compo- 

Start Page the client views when selecting the Hamelin link; 25 ncuts of the Hamelin system when constructing/hiding the 

FIG. 8 is one illustrative embodiment of an introductory pointer and moving the pointer respectively; and 

viewed by the client; FIGS 38 ^6 39 show the actions taken by the compo- 

FIG. 9 is one illustrative embodiment of the client's nents of the Hamelin system when constructing/hiding and 

display screen when an initial frameset is loaded; moving the whiteboard, respectively. 

FIG. 10 is one illustrative embodiment of the guide's ^ Whenever possible, the same reference numerals are used 

display screen when the initial frameset of FIG. 9 is loaded; to reference the same elements in different FIGS. 

FIG. 11 is one illustrative embodiment of the guide's 

display screen when implementing a shared whiteboard; DETAILED DESCRIPTION 

FIG. 12 is a high-level block architectural diagram of an 35 A. Terminology 

illustrative of a logical view of the Hamelin system; 1. Clients and guides 

FIG. 13 is diagram of software components associated To place in perspective the detailed description of the 

with elements of the architecture depicted in FIG. 12; present invention, it is mstnjc.tiYAjc_proyjde some basic 

FIG. 14 is a flow diagram depicting session construction; terminology. Users^o Tthe system in a ccordance wiuVthe 

FIG. 15 is a flow diagram that depicts the actions that 40 J"*? 3 *^ Hamelin system 

occur in the director application during session construction h ^ inafter ) / Dchlde f^^h^^fi^ Achcutjs a user 

of FIG 14" a com puter in agr owser-based telecommunicatio ns net- 

' a j . , . work who, e.g., sen ds messa ges to the guide, receives 

FIG. 16 is a flow diagram that depicts the actions that messages.fr,o.mJhe^de. re ceiveTWeb pages and/oTlnte r- 

occur in the client Web browser to load the presentation 45 nerRe^ojux^d^m^ 

frameset and frame containing the client-side component; a collaborative conferencT Th^^ of a computer 

FIGS. 17A-17C is a flow diagram that depicts an illus- in the tele commuDications network who leads one or m ore 

trative example of how the MkFrameSet program dynami- cl ients by"sen3ing messages to client(s) and/or propa gating 

cally creates a frame layout; Web pages and/or Internet Resources to the clients ) for 

FIG. 18 is a flow diagram that depicts operations of the 50 display. A guide can coordinate collaborative tools such a s 

director application to change a frame layout; a chat program, shared whiteboard, shared pointer, distn p- 

FIG. 19 is a flow diagram that depicts operations of the ut ed pasteboard, and videoconferencin g, 

director application to change the contents of a frame; 2. Frame layouts and framesets 

FIG. 20 is a flow diagram depicting the steps taken by the can load framesets or alternatively, load frame 

director application when recording a session; 55 layouts and then load Internet Resources, Web pages, or 

FIGS. 21, 21A, 21B are flow diagrams of the steps taken collaborative tools into individual frames. A frame layout is 

when a client requests playback of a session- an arrangement of one or more frames without contents. 

FIG. 22 is a flow diagram of the steps taken by the director J£ m ™^ "^jrar^y^ 

application for replaying sessions: 4ArAM shows embodiments of frame layouts that 

ia a u I f4 , . , . . . . 60 are predefined in the Hamelin system. Frame layout 4A 

FIG 23 is a flowchart of the steps taken by the director C0Dtains 0Q€ frame Frame layo ^ 4 B , 4C) 4H , and 41 

application during the replaying process; contam ^ {m Frame 4D _^ ^ ^ ^ m 

FIG. 24 is a diagram of the graphical user interface of the contain three frames. Frame layout 4L contain four frames, 

session editor; Additional frame layouts can be defined by the guide. 

FIG. 25 is a flow diagram that depicts how page changes 65 A frameset is an arran g ement of frames ( i.e. frame layout) 

are communicated from the guide system to the client an d the frame contents for each frame . The frame contents 

systems; can be anything available on the Web, such as Web pages 
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and/or Internet Resources, or alternatively a collaborativ e ist and the client is a user requesting help. Assume that the 

t ool such as a chat program. A frameset can be loaded in one client initiates a request from a Web page for Bellcore 

operation and unlike traditional frames, the frames in a AdaptX® system products. With reference to FIG. 6, the 

frame layout can be dynamically and individually changed cHeot has already loaded the Web page for AdaptX products 

by the guide. Using framesets, sophisticated screen layouts 5 containing the Hamelin Help Desk into her PC system. The 

can be accomplished^ cliem (hen a Hamclin link m order t0 initiatc a u 

A frame can itself contain one or more frames (called mtcractivc with thc guidc< In Fia 6> the Web 

S£ ^ e l a m ^!n TJi°f WS °! ™ h r ° f contai ^ the Hamelin link entitled "Technicians" 602. Once 

these child frames can itself contain one or more frames *u* i- i • , . , , , . . - A ™- „ 

arranged in rows or columns, and so on. This recursive unk is selected by the client, with reference o FIG. 7, 

feature of the frames allows layouts of arbitrary complexity 10 a H u ame J^ Start Pa ^ 702 t ? s P resented to < he screen 

to be denned. Furthermore, the frames themselves can be on her PC s y stem * Hamehn Start Page 702 is a Web page 

addressed individually s o that any Internet R esomce^Web containing Internet Resources such as text 704 which typi- 

page, or collaborative tool can be loaded into any frame. callv rec l uests the use r to wait for a guide or provides other 

inSgndent oi the^ej^fr^mes. This contrasts with the pertinent information. 

no rmal use offrames, where a pag e is authoredJ ojise,a fixed 15 The diagram of FIG. 8 shows what the guide views on his 
frame l ayout and a limited jset.oOVeb.pag es as the content display screen. Here, the guide is working on a session 
of the frames (i.e. for example, a frame containing a table of unrelated to Bellcore AdaptX systems which involves pro- 
contents and another frame containing one of a selected viding information to another client regarding lawnmowers. 
number of content pages). Once the client selects Hamelin link 602 as previously 
3. Sessions 20 discussed with FIG. 6, the guide receives a pop-up box 802 
Each guide hosts one or more sessions. A session is an on his display screen. The pop-up box 802 informs the guide 
exchange of communications between two computers of the that a client is requiring assistance, and thus, requesting a 
teleco_rnm.unications _network. An element caU edihe system new session. When the pop-up box 802 appears requesting 
serv er or piperserver (discussed below) acts.an intermediary a session concerning Bellcore AdaptX products, the guide 
between, the guide and client s. FIG. 5 shows the interrela- 2 S can accept or refuse. If the guide/specialist chooses to 
tionship between piperserver 502; sessions, namely Session accept, then a new session is initiated by the Hamelin 
l.and Session 2; guides 504 and 506; and clients 508, 510, system. 

and 512. Piper server 502 manages sessions and clients Typically, at the start of the session, the client will be~" 

attached to sessions. Each client is a member of exactly one presented with an introductory page in the client Web 

session and each session is essentially independent of other 30 browser such as shown in FIG. 9. The client Web browser 

sessions. The maximum number of clients and sessions is exemplified is the Microsoft Internet Explorer in FIG. 9. The 

dependent onl y on the tech nical capabilities of piper server conventional browser renders two main components: pre- 

502- sentation frameset 902 and frame 904 which contains a 

Sessions can be startedj ntwo wa ys: the guide can initiate client-side component (which is basically hidden under 

a new session, or a client can request a new session. For a 35 control of the client— the client side component of frame 

guide initiated session, the session type must be selected by 904 will be discussed in more detail shortly), 

the guide. The session type specifies a starting Web page and Presentation frameset 902 contains a frame layout and 

an initial set of Internet Resources. For a client initiated frame contents. In this illustration, the guide has selected 

session, the client selects a link called a "Hamelin link" frame layout 4K (from among the frame layouts set forth in 

located in a Web page received b y the clie nt and the session 40 FIG. 4). Then the guide has loaded the contents into the 

type is specified in the Web page that requests The session. frame layout. Alternatively, the guide can select a frame 

In FIG. 5, there are two sessions, Session 1 and Session layout and fill the contents of its frames in one action, by 

on piper server 502. Each guide can, manage one or more loading a frameset for display by the client. In this embodi- 

sessions. In FIG. 5, guide 504 manages Session 1 and guide ment of the invention (i.e. FIG. 9), presentation frameset 902 

506 manages Session 2. There is typically one guide for each 45 has a frame layout that comprises three frames: frame 906, 

session. Each session can have one or more attached clients. frame 908, and frame 910. 

Here, Session 1 is an exchange of communications between Frame 906 contains a still picture of the guide/specialist, 
the guide 504 and client 508. Session 2 has guide 506, client The picture is, for example, implemented using the Joint 
510 and client 512 attached to it. Additional sessions can be Photographic Expert Group (JPEG) format which is a stan- 
added to piper server 502. 50 dardized image compression mechanism designed for corn- 
There are various types of sessions available including a pressing either full-color or gray-scale images of naturalr- 
live, interactive session in which the client asks questions of real-world scenes. 

the guide, and the guide uses the Web pages, Internet Frame 908 contains a chat program (i.e. talk chat) for 

Resources, and collaborative tools to reply. Other sessions communicating questions to the guide. In this instance, the 

include: (1) recorded sessions (capable of later playback and 55 client has typed "Tell me about Adapt/X solutions" which 

editing); and (2) non-interactive live, broadcast sessions. will be sent to the guide by pressing the Send icon 912. 

Examples of five, broadcast sessions include teaching les- Frame 910 contains a Web page that the guide has chosen 

sons (with no student feedback), intercasting (i.e. support for to show the client in response to the client's request for help. 

Web-based enhancements of live television and radio The Web page contains information about Adapt/X 

events), and guided tours of the Web. 60 products/solutions. The client can scroll the information or 

B. Applications of the Hamelin System follow links on this Web page. Anything that the client does 

The following are illustrative applications of the types of to the Web page will be viewed by the guide on his guide PC 

sessions available and are meant byway of example and not system in a synchronized manner. Likewise, the guide can 

to limit the application of the invention. scroll the information or follow links on the Web page and 

1. Help desk 65 this will be seen by the client. 

A live, interactive session has utility in a help desk Frame 904 contains the client-side component which is 

environment. The guide can be a technician or help special- the mechanism that enables the client to view the informa- 
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tion provided by the guide (and vice versa if technology such 2. Sales and marketing environment 

as ActiveX controls are used to create the client-side In a sales and marketing environment, if a user (i.e. client) 

component). Frame 904 is typically a small, almost hidden requires personal assistance in finding information on a Web 
bottom frame that can be expanded by the client. For site, a real-time, interactive session can be constructed for 

example, frame 904 can be expanded to expose a down- 5 toe client to ask questions of the sales person when a 

loaded applet program. Hamelin link is followed. The salesperson (i.e. guide) can 

FIG. 10 is an illustration of the guide's display screen show the client Web pages and/or Internet Resources such as 

simultaneously viewed when the client sees the contents on a P r °duct in an electronic catalog. The salesperson can then 

her display screen upon typing a question. The guide immediately take the client to a Web page to purchase the 

accesses a "special purpose browser" which may be imple- to * tem - T° e salesperson and client can engage in a collabora- 

mented using the exposed, building block components of a tive conference to further facilitate the exchange of infor- 

conventional browser, such as Microsoft Internet Explorer mation. The operational environment of the Sales applica- 

or Netscape Navigator. It is required that the guide -and ^ on ^ commensurate with the operational environment of 

client(s) use the same underlying conventional browser for ^ e Help desk, 

the Hamelin system to function properly. The mspjayjscreen 15 3. Educational environment 

of toe j^uide PC systeln^^ntains^ In an educational environment, learning and education 

recording controrframe 1002, main resource frame 1004, can occur using a live, interactive session between a teacher 

frameset frame 1006, preview frame 1008, and remotely (*- e - guide) and a plurality of students (i.e. one or more 

Viewable frame 1010. Remotely displayable frame 1010 is clients). The teacher has fast random access to a host of 

fcomposed of three frames viewed by all attached clients. 20 Internet Resources which include text, images, video and 

/The other frames 1002, 1004, 1006, and 1008 are referred to audi o clips; Web pages; and collaborative tools such as chat 

(as locally displayable frames. programs and whiteboards. By way of example, a remotely 

Preview frame 1008 contains a personal Web browser that displayable frame can contain a JPEG image of a viewgraph; 

uXguide can use-to jindjy)articular Web page. If the guide a live audio/video feed; a distributed pasteboard for 

finds a Web page he wants to show to the client, the found 25 exchanging and editing text files; and a distributed white- 
Web page can be copied to one of the frames in the current ' board for joint editing of pictures. A chat program such as a 

frame layout located in remotely displayable frames 1010. CDat applet can be implemented to enable students to ask the 

For instance, the found Web page could be copied into, for teacher questions. 

example, frame 1012 of frames 1110. The other frames in Alternatively, in lieu of the live, interactive session, the 

FIG. 10 will be described further when the details of the 30 session can be a recorded session which presents lessons, 

C system architecture are set forth below. guest speakers, and how-to courses. Any of the live, inter- 

^ r FIGS. 9 and 10 are shown for illustrative purposes only. active sessions can be recorded for later playback and/or 

For example, frame 906 in FIG. 9 can contain a live video editing. The session can be saved in a file and later played 

feed of the guide/specialist rather than a still picture. back on demand or at scheduled times for large numbers of 

As another example, consider FIG. 11 which shows 35 students to watch, 

another illustrative embodiment of the guide's display 4. Intercasting environment 

screen when a collaborative tool such as a shared whiteboard Intercasting is the simultaneous delivery of synchronized 

is implemented and the frame layout in the remotely dis- Web pages along with other broadcast medium such as 

playable frames 1010 is but a single frame (i.e. the frame television and radio. For example, Internet Resources can be 

layout of FIG. 4A). Using the shared whiteboard, the client 40 transmitted as data into a television broadcast. For recorded 

and specialist can exchange notes and diagrams. This frame events, the Hamelin system is arranged with an editor and 

1102 contain a Web page having information on Adapt/X playback tool to associate Web pages with times and events 

products. in the broadcast for recorded events. For Web guided tours, 

Shared pointer 1103 can also be implemented so that the the Hamelin system provides clients with an overview of the 

guide can elaborate on a question from the client. The guide 45 highlights of a Web site by providing an audio and video tour 

can tell the client to "click here" via the whiteboard method supplemented with Web pages from the site, 

for further information as depicted at 1104 and can circle a 5. Guided tours of the WWW 

feature of the Web page, as shown at 1106, and write that A guided tour of the WWW is another application. A 

these are "target AaV in response to a question posed by a guide can record a set of tours and any number of users (i.e. 

client using the whiteboard method. 50 clients and guides) can later follow the tour. Typically, the 

Alternatively, the client can show items to the guide/ tour will be accompanied by an audio and/or video track 

specialist. For example, suppose a client is having problems describing the places that the guide is taking the client. The 

running an application program. The guide can load a Web tours can be organized so that a client can join the tour in 

page containing a chat applet. The client can paste a suspect progress or can start a recorded tour on demand. Clients can 

configuration file into the chat applet. The specialist can edit 55 drop out of a tour to explore on their own at any point, 

the file and the client can paste the file back into her The Hamelin system (particularly the editor) can be used 

application so that the application runs properly. to construct tours of points of interest in the whole WWW 

The help desk could optionally be a video help desk. or a tour of a company's individual Web site. For example, 

Users of a video help desk would need a soundcard and a tour of legal resources available on the Web such as the 

microphone hooked up, a video camera, and videoconfer- 60 Federal Register, state and Supreme Court case law, Federal 

encing software. If the guide/specialist has a video detailing Rules of Civil Procedure and statutes available can be 

a solution to the problem, it is a simple matter to start the recorded. A legal practitioner can use this tour to learn about 

video playing in one of the remotely displayable frames legal research resources available on the Web. 

1010 and then the specialist can aid the next user with a C. The architecture of the Hamelin System 

problem. The videoconference can be started merely by the 65 FIG. 12 shows a high-level block diagram of one illus- 

specialist loading the appropriate Web page into the desired trative embodiment of the Hamelin system 1200, a system 

frame of remotely displayable frames 1010. for managing interactions between users (i.e. guides and 
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clients) in a browser-based telecommunications network. is involved when the client clicks on the Hamelin link. The 
System 1200 includes the following elements: system Hamelin link contains an encoded command which includes 
(piper) server 502; HTTP server 1204; at least one guide information on the HostName and the "type" of session 
system 1206; and at least one client system 1208. With [The HostName is eventually provided to piper server 502 

reference to FIG. 1 for comparison and contrast, the arrange- 5 and typically, it is the name of the computer piper server 502 

ment of system 1200 provides a logical view of the system is running on]. 

in accordance with the present invention, as distinct from a Next, at process block 1404, client Web browser 1312 

physical implementation. In terms of actual physical contacts HTTP server 1204. HTTP server 1204 invokes 

implementation, communication via the browser-based net- Session program 1302 at process block 1406. The param- 

work among servers 502 and 1204 and guide system 1206 io eters encoded in the Hamelin link are passed to Session 

and client system 1208 uses packets propagating serially program 1302 via the GET QUERY command issued to 

based upon the TCP/IP protocol. But, note that guide system HTTP server 1204. Session program 1302 contacts appro- 

1206 only communicates directly with HTTP ttrvrx 1 204 prfate director application 1306 at process block 1408 and, 

and system server 502; server 502 only communicates for this example, requests a new live session 

directly with guide system 1206 and client system 1208; 15 At decision block 1410, the guide decides whether to 

client system 1208 only directly communicates with servers accept a request for a new session. If the guide chooses to 

1204 and 502; and, finally, server 1204 only communicates not accept the session, then at process block 1412 a Web 

directly with systems 1206 and 1208. Accordingly, system page is returned to the client stating that the session has been 

1200 represents a logical model for the inter-element denied. If the guide chooses to accept the session, then via 

communications, with the direct communication paths 20 process block 1414, a SessionName (name of the session 

shown as separate logical paths. This model is used for randomly generated in a string format) is returned to Session 

elucidation purposes so as facilitate the detailed description; program 1302. Next, at process block 1416, director appli- 

however, the physical implementation depicted by FIG. 1 is cation 1306 instructs piper server 502 to construct a new 

actually utilized in practice. session. The connection between piper server 502 and 

Piper server 502 communicates using a Web Guide Pro- 2 5 director application 1306 remains intact throughout the life 

tocol (WGP) which is written on top of TCP/IP. HTTP server 0 f the session. 

1204 communicates using the HTTP protocol. Guide system At process block 1418, Session program 1302 returns 

1206 and client system 1208 both communicate using TCP/ HTML describing two response framesets to client Web 

IP> browser 1312. One frameset is presentation frameset 902 

Each of the elements m FIG. 12 has one or more associ- 30 and the other frameset contains the client-side component 

ated software components as depicted in FIG. 13. HTTP 904. Then, at process block 1420, the client Web browser 

server 1204 has two Common Gateway Interface-Binary 1312 renders the display of presentation frameset 902 and 

programs (cgi-bm programs) that include Session program the frameset containing the client-side component 904. 

1302 used for session construction and management and FIG. 15 depicts what occurs in director application 1306 

MakeFrameSet program 1304 used to create frame layouts. 35 during session construction when the Session program 1302 

Guide system 1206 has a software co mponent called direct or is invoked to create a live session. Id essence, FIG 15 shows 

application 1306, wfac^ include^ jhfi realization ojUthe process blocks starting at 1408 of FIG. 14 in more detail At 

"special-purpose" browser. Piper server 502 has WGP 1308 process block 1502, director application 1306 is started 

fofcommumcahng with guide system 1206 and client automatically if it is not already activated upon receipt of a 

system 1208. Client system 1208 has software components 40 session request. Next at process block 1504, director appli-^ 

that include client Web browser 1312 and client-side com- cation 1306 accepts the command, RequestNewSession, 

ponent 904. from me Session program 1302. 

1. HTTP Server 1204 Next, at process block 1506, a dialog box appears que- 

The HTTP Server 1204 is conventional and typically rying if the guide wants to accept the session. After the 

works as described in the Background of the Invention 45 dialog box appears, the guide must decide whether to accept 

Section. It contains additional programs in its cgi-bin the session. If the guides decides not to accept the session 

directory, namely Session program 1302 and the Make- (process block 1508), then at process block 1510, a failure 

FrameSet program 1304, discussed below. HTTP Server code is returned to Session program 1302. If the guide 

1204 in the Hamelin System particularly executes as fol- accepts the session (typically, by clicking on "okay" in a 

l° ws - 50 dialog box), then at process block 1512, director application 

In order to start a session between the guide and a client, 1306 loads resources appropriate to the session (i.e. intro- 

the client typically selects a Hamelin link on a Web page ductory Web page and frame resources), 

displayed in the client Web browser 1312. The Hamelin link Next, at process block 1514, a display window is shown 

issues a so-called GET QUERY command to HTTP server with a starting configuration. Piper server 502 is contacted 

1204. This command causes HTTP server 1204 to invoke 55 by director application 1306, at process block 1516, and a 

Session program 1302 (session.exe) in the cgi-bin file direc- new session is constructed with a unique string name given 

tory to initiate a session between the guide and client. (i.e. SessionName). At process block 1518, the current frame 

Session program 1302 is used for session construction and layout is sent to piper server 502 and at process block 1520, 

administration. Session program 1302 is multifunctional, and a success code is returned to Session program 1302 once 

depending on client's/clients' requests), and includes these 60 piper server 502 acknowledges receipt of SessionName. 

options to: create a live session; start a stored session; list FIG. 16 depicts what occurs in client Web browser 1312 

active sessions, allow clients to join already running ses- during session construction when Session program 1302 is 

sions; list the guide and/or clients participating in a session; invoked to create a live session. In essence, FIG. 16 shows 

remove a session and all connected users; and/or remove a process block 1420 of FIG. 14 in more detail, 

client from a session. 6 5 At process block 1602, client Web browser 1312 parses 

FIGS. 14-17 show the construction of a live session in the HTML and issues two new session requests 

more detail. With reference to FIG. 14, process block 1402 (SessionFramePresentation (i.e. blocks 1604-1608) and 
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SessionFrameAppletCreate (i.e. blocks 1610-1618)). Pro- 
cess blocks 1604-08 and process blocks 1610-1618 occur 
simultaneously. Process blocks 1604-08 depict the steps for 
the SessionFramePresentation which loads the frame con- 
tents in presentation frameset 902 and process blocks 
1610-1618 depict the steps for SessionFrameAppletCreate 
which loads the frame contents of the bottom frame which 
contains client-side component 904. 

Turning now to process block 1604, a command, GET 
QUERY is issued to the HTTP server 1204 to fill presenta- 
tion frameset 902. Next, at process block 1606, Session 
program 1302 is invoked returning the HTML describing the 
introductory Web page. The introductory Web page typically 
tells the client to "Please wait". Next, process block 1608 is 
operated to display the "Please Wait" frame. 

Simultaneously, at process block 1610, Session program 
1302 is passed the HostName and the SessionName. The 
HostName and SessionName parameters originate in HTML 
of the Web page. The command in HTML is typically, 
session.exe?New_piper server where piper server is Host- 
Name. The HostName can also be set dynamically via a 
cgi-bin script. 

Next, at process block 1612, Session program 1302 
constructs a Web page that contains client-side component 
904 and the parameters: HostName and SessionName. Next 
at process block 1614, client Web browser 1312 parses the 
HTML and issues a request to HTTP server 1204 to load 
client-side component 904. This request is typically a GET 
QUERY command. After client-side component 904 is 
downloaded at process block 1616, it parses the parameters, 
HostName and SessionName. Client system 1208 connects 
to piper server 502 using the same SessionName as provided 
by director application 1306. Client-side component 904 
contacts piper server 502 and asks to join the named session 
at process block 1618. 

If client-side component 904 is an applet, the applet needs 
to know the HostName, SessionName, the port number of 
piper server 502, and finally an action which is join a session 
in this case. When the applet is downloaded, it will contact 
piper server 502 and establish a communications link that 
will be used to accept instructions to load Web page, Internet 
Resources, and collaborative tools. 

The underlying communications link is a TCP/IP connec- 
tion from the client to piper server 502. In particular, the 
Web page or HTML that contains the applet is dynamically 
written by Session program 1302 after it has communicated 
with director application 1306. At this point, both director 
application 1306 and Session program 1302 know the Ses- 
sionName, The SessionName is passed as a parameter to the 
client. 

The default startup frameset and contents will be com- 
municated to client-side component 904. Throughout all of 
this, the connection between piper server 502 and director 
application 1306 remains intact throughout the life of the 
session. 

At this point, all of the communications connections are 
established. The session will normally now consist of com- 
mands to load frames and commands to load framesets. 
Commands to load frames are communicated from director 
application 1306 to piper server 502. Piper server 502, then 
communicates the commands to all the connected client-side 
components 904. 

For the commands to load framesets, the communications 
path is the same, but frame layout is generated by the cgi-bin 
program, MkFrameSet.exe, which returns the appropriate 
frame layout. This application program accepts a simple 
string-based description (i.e. codeword) of the required 
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frame layout, and dynamically constructs frames in the 
browser. The codeword contains F (construct a frame)Rm 
(construct m-rows) Cn (construct n-cohimns) where the 
string is interpreted as applying left-to-right, and top-to- 
5 bottom in the appropriate browser. 

The string is parsed from left to right, and the frame layout 
is defined recursively, applying frame definitions to existing 
frames left-to-right and top-to-bottom. For example, F gen- 
erates a single frame occupying the whole browser, C2FF 
io generates two column frames of equal size, and R2FF 
generates two row frames of equal size. 

A more complicated example is C2R2FFF which is 
depicted in FIG. 17. The result of invoking MkFrameSet 
program is the generation of two column frames, with the 
15 left-hand column frame being split into two row frames. In 
particular, MkFrameSet program will parse "C2" and create 
two column frames as shown in FIG. 17A. Next, 
MkFrameSet program will parse off "R2" and create two 
row frames in the left-hand column as shown in FIG. 17B. 
20 Next, MkFrameSet program will parse off the first "F" and 
fill the frame of the top row frame found in the left-hand 
column; next parse off the second "F" and fill the frame of 
the bottom row frame found in the left-hand column; and 
then parse the final "F" to fill in the right-hand column 
25 frame, as per FIG. 17C 

One further enhancement is that the relative size of the 
row and column frames can also be set by following a row 
or column count with percentage sizes (also applied left-to- 
right, top-to-bottom). Thus, C2[70,30]FF generates two col- 
30 umn frames with size ratio 70:30 (the top column being 
larger). Additionally, C3[30,40,30]FC2[10,90]FFF will gen- 
erate three column frames, the middle frame being larger 
than the left frame and right frame. The middle column 
frame has two row frames, the top frame being nine times 
35 smaller than the bottom row frame. 

4. Guide system and director application 
As previously mentioned, guide system 1206 has a soft- 
ware component called director application 1306 that 
enables the guide to have fast random access to Web pages, 
40 Internet Resources, and collaborative tools, that is, basically 
anything available on the Web and created for use in the 
Internet (or even an intranet or an extranet). Director appli- 
cation 1306 allows flexible use of the display screen. 

a. How the Guide Changes the Frame Layout and the 
45 Frame Contents 

As previously discussed, the guide can change framesets, 
frame layouts and frame contents at will. FIGS. 18 and 19 
depict the steps taken to change the frame layout and frame 
contents respectively. Changing a frameset involves first 
50 changing the frame layout (per FIG. 18) and then the frame 
contents (per FIG. 19) are changed for each frame. 
Alternatively, the frameset can be loaded in one operation 
(per FIG. 20). 

Turning now to FIG. 18, in order to change the frame 
55 layout, the guide selects one of the predefined frame layouts 
shown by director application 1306 (i.e. see explanation at 
FIG. 4) at process block 1802. The frame layout has a 
codeword (simple string-based description) associated with 
it. 

60 Next, at process block 1804, HTTP Server invokes 
MkFrameSet program to generate a new frame layout. The\ 
codeword is used as a parameter to the MkFrameSet pro- 1 
gram. 

Next, at process block 1806, director application 1306 
65 passes an instruction to piper server 502 to invoke 
MkFrameSet program using the codeword as a parameter to 
set local-view frame to a new frame layout. Piper server 502 
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saves the changes made to the current frame layout, purges 
the current frame contents of all previously existing frames, 
and then passes this information to all connected clients via 
client-side components 904 at process block 1808. 

At process block 1810, client-side component 904 5 
instructs client Web browser 1312 to load a new frame 
layout from HTTP server 1204. HTTP server 1204 requests 
a dynamic frame layout generated by MkFrameSet Program 
1304 at process block 1812. HTTP server 1204 invokes 
MkFrameSet Program 1304 with the appropriate codeword, to 
MkFrameSet Program 1304 returns the HTML describing 
this frame layout to client PC system 1208. 

TUraing now to FIG. 19, there is shown the steps taken to 
change the contents of a frame. At process block 1902, the 
guide initiates a change to the contents of a frame. The 15 
contents of each frame itself can be changed in numerous 
ways. Some of these include: a new Web page can be loaded 
by selecting a resource item from one of the resource groups 
located in the main resource frame 1004 or frameset frame 
1006; a new Web page can be loaded by dragging and 20 
dropping it from the preview frame 1008; a link on a Web 
page can be followed in any of the frames in the remote ly- 
displayable frame 1010; a post method (i.e. a way that a 
client can send some information back to HTTP server 1204 
such as typing something in a text box and clicking on the 25 
icon to submit it) or any other database query can be issued 
in a frame; the contents of any other frame can be dropped 
into the frame or sub-frame; the last Web page can be 
revisited; any URL maintained in the history of the frame 
can be revisited; a URL can be manually typed in; a frame 30 
can be cleared when a new frame layout is requested; or a 
frame and the contents of all of the other frames and the 
frame layout itself can be changed when a new resource item 
is loaded. Using director application 1306, the guide initiates 
one of these changes. 35 

Next, at process block 1904, the guide is presented with 
a dialog box showing available target frames (i.e. any of the 
frames in the current frame layout). At process block 1906, 
the guide selects (i.e. typically by clicking with a mouse), a 
target frame. The target frame is loaded with the contents of 40 
the new URL at process block 1908. 

The URL and name of the target frame is forwarded to 
piper server 502 at process block 1910. Director application 
1306 passes the URL of the Web page and the address of the 
frame it is to be loaded into to piper server 502. Piper server 45 
502, at process block 1912, saves the change made to the 
current frame layout and then forwards the change to 
client-side components 904 of all the connected clients. At 
process block 1914, client-side components 904 instruct 
their respective client Web browsers 1312 to load a new 50 
URL into the named target frame. In response to the frame 
change request, at process block 1910, the client Web 
browser 1312 for each client issues one or more requests to 
Web servers 1204 for the HTML (for Web pages) and/or 
Internet Resources or alternatively initiates a collaborative 55 
tool. 

With reference to FIG. 20, there is shown a method for 
loading a frameset in one operation. At process block 2002, 
the guide selects a predefined frameset from the frameset 
frame 1006. Next, at process block 2004, director applica- 60 
tion 1306 sends a frame description string to piper server 
502 for communication to clients. A new frame layout is 
displayed in remotely displayable frame 1010 at process 
block 2006. The new frame layout is sent to piper server 502 
for communication to all connected clients at process block 65 
2008. Next, at process block 2010, the new frame contents 
are sent to each of the new frames in remotely-displayable 
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frame 1010. Finally, at process block 2012, the new frame 
contents for each frame are sent to piper server 502. 

b. The Remote Procedure Call Interface 

Director application 1306 has a Remote Procedure Call 
(RPC) interface. An RPC is a way for a program to call a 
function on another computer or another process on the 
same computer. The RPC interface allows two computers to 
communicate and send messages. The RPC interface of 
director application 1306 has two methods 
(RequestNewSession, and RequestPlay) and it is only used 
during session setup. It is connected to Session program 
1302 when a new live session is started using the Request- 
NewSession. It is defined by a standard Interface Descrip- 
tion Language (IDL) interfaces file. After the guide accepts 
or declines the session, the RPC connection is dropped. The 
format of the RequestNewSession command includes the 
following parameters: RemoteHost (host name), RemoteAd- 
dress (client IP address), QueryString (everything up to and 
including session program), SessionType (i.e. NEW, 
A-NEW, DEFAULT, etc.), and SessionName. 

The RPC interface is also used once for each recorded 
session via the RequestPlay. The parameters are just like 
those included in the session.exe?REPLAY invocation. 

c. Internal Objects 

The director application 1306 is, in a preferred 
embodiment, an event driven, basically single threaded 
multiple-document, Microsoft Foundations Class (MFC) 
application. It handles three document types: live sessions, 
session editing, and playback of recorded sessions. Each 
document type has a document and view class. 

d. The interface 

Director application 1306 allows one or more guides to 
show any connected clients) Web pages, Internet Resources 
or anything located on the Web as well as initiate collabo- 
rative tools. The interface of director application 1306 has a 
GUI as shown previously in FIG. 10. The interface has five 
resizable frames: recording control frame 1002, main 
resource frame 1004, frameset frame 1006, preview frame 
1008, and remotely displayable framesets 1010. Recording 
control frame 1002, main resource frame 1004, frameset 
frame 1006, and preview frame 1008 are controls containing 
resources for the session. 

Recording control frame: Recording control frame 1002 
enables the guide to record a presentation in real-time. The 
recording can be paused if desirable. 

Main resource frame: Main resource frame 1004 has a 
facility for grouping and organizing resources. At the top of 
the main resource frame 1004 is a pull down menu of 
resource groups which contain resource items. Resource 
items are Internet Resources, URLs (i.e. pointers to Web 
pages or pointers to other resource items), or collaborative 
tools which can be organized by subject. Resource groups 
are a tree of resources items that are named. This tree of 
resource items can be expanded (to show all of the resource 
items in a resource group) or contracted (to show only the 
main categories of resource items). 

For example, there can be a resource group called pets. 
Within the resource group can be resource items that include 
dogs, birds, and fish. The resource item called dogs can be 
further refined to include resource items such as Chocolate 
Labrador, German Shepherd, and French Poodle. If the tree 
is contracted, then only the resource items dogs, birds, and 
fish will be shown to the user. If the guide expands the 
resource item called dogs, then Chocolate Labrador, German 
Shepherd, and French Poodle will be shown as well. In FIG. 
10, there is one resource group called Main Hamelin Links 
1012 and it contains resource items named Bellcore 1014, 
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Catalogs 1016 and Education 1018. These resource items 
contain further resource items (i.e. Bellcore 1014 contains 
the resource items Adapt-X Rave 1020, Adapt-X Internet 
Solutions 1022, etc. and Catalogs 1016 contains the resource 
items named Oldsmobile 1024 and Sears 1026). 

Since resource items can be arranged by subject, a set of 
resource items appropriate for the session can be selected 
without having to navigate through a deep tree. The contents 
of the tree (i.e. resource items) are shortcuts, pointers and 
URLs to Internet Resources, Web pages, and collaborative 
tools. A single Web page, Internet Resource, and collabora- 
tive tool can be referenced more than once in each resource 
group. Bookmarks can be utilized to identify Internet 
Resources, Web pages and collaborative tools that are used 
frequently by the guide. 

Resource items can be selected by the guide and the Web 
page or Internet Resource that resource items point to can be 
placed in a frame located in the preview frame 1008 or any 
of the frames located in remotely displayable frame 1010. If 
the resource item selected is a URL to a Web page, then the 
browser communicates with HTTP server 1204 having that 
URL. HTTP server 1204 sends HTML to the browser to 
construct the Web page. 

Resource groups and resource items that the guide uses 
are loaded in the main resource frame 1004 when the session 
is initiated. 

Frameset frame: Frameset frame 1006 contains resource 
groups (described previously when discussing the main 
resource frame) and also framesets. Groups of framesets (i.e. 
frame layouts and its contents) can be arranged in exactly the 
same way as resource groups. Bookmarks can be utilized to 
identify Internet Resources and Web pages that are fre- 
quently used by the guide. 

Selecting a resource item in the frameset frame 1006 
constructs a new frameset (i.e. introduces a frame layout and 
fills the contents of the frames which comprise the frame 
layout at the same time). This is advantageous since the 
guide does not have to load Web pages, Internet Resources, 
etc. into each frame individually, can predefine what will be 
shown to a clieot, and saves time. 

Preview frame: Preview frame 1008 contains a browser 
which provides the guide with the capability to view a Web 
page and Internet Resource first before allowing the client to 
see it. Actions such as double-clicking on a resource item 
loads it into the preview frame 1108. This allows the guide 
to make sure the correct information is shown before it is 
displayed to the client. 

The contents of preview frame 1008 are not immediately 
shown to the client and can be thought of as a scratch pad 
to finding Web pages and Internet Resources. The scratch 
pad can be used to follow links from a Web page until a 
desired Web page is reached; to access a search engine and 
issue queries; to be used to preview and insure the appro- 
priate Web page or Internet Resource is going to be shown 
to the client; and to use for any of the other available ways 
that the Web is navigated. When the desired Web page is 
found, it can be pasted into any of the frames in remotely 
displayable frame 1010 which are visible to the client. 

Remotely displayable frames: Framesets 1010 contains a 
personal browser that shows what the client(s) sees on the 
client Web browser 1312. Director application 1306 will 
ensure that anything located in framesets 1010 will be 
automatically shown to all connected clients. The informa- 
tion displayed on client Web browsers (except for the frame 
containing the client-side component 904) is an exact map- 
ping of the contents of the guide's remotely displayable 
frames 1010. 
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Just like any other browser, the personal browser of 
framesets 1010 is fully programmable and supports such 
features as applets, plugins, scripting, and ActiveX controls 
to add intelligence and interactivity to Web pages. Framesets 

5 1010 maintain its own history (i.e. a listing of the URLs 
most recently visited). 

Each frame can be thought of as a fully featured Web^ 
browser so the frames can contain any content normally 
associated with the Web. This includes Internet Resources 

10 such as images, text, tables, forms, and plugins playing 
video or audio. Useful plugins could include a whiteboard 
shared between the client and the guide, a window contain- 
ing a chat program (i.e. the client can ask questions of the 
guide), and an applet implementing videoconferencing. All 

15 of these permit predefined resource items to be shown to the^ 1 
client by the guide, 
e. Session Editor 
Besides allowing a live, interactive session between users, 
director application 1306 has the capability to provide 

20 recording of sessions, later playback of a recorded session, 
and editing of a session. 

1. Recording a session 

A recording of a session allows any user (i.e. guide or 
client) to construct a tour of the Web. The recording of the 

25 session and any editing to the session is constructed off-line. 
The steps taken by director application 1306 when recording 
a session are as follows: (1) a real-time event such as loading 
a frame layout, loading a Web page, or loading a frameset 
has occurred; and (2) if the director application 1306 is 

30 recording (i.e. the client or guide has selected recording and 
paused is not selected), then the real-time event and time is 
saved in an event list. This process continues until an action 
such as pause is selected. 

2. Playback of a Session 

35 When clients on the Web request playback of a recorded 
session, no action is required by the guide. To start a 
playback of a session, the appropriate item is selected from 
the main menu. A file is selected and a control window then 
opens. A control window allows the client to start, stop, and 

40 seek in the animation as well as control whether the anima- 
tion loops or automatically deletes itself when the animation 
finishes. For demos and previewing, a browser that will 
show what the remote clients will see is also supported. This 
is launched when an appropriate button or menu item is 

45 selected. 

Director application 1306 can play back recorded sessions 
on demand from a client or under the guide's control. FIG. 
21 shows the a flow diagram of the steps taken when a client 
requests playback of a session. At process block 2102, a 

50 client requests playback of a recorded session by clicking on 
a hyperlink such as "Replay Session". There is a command 
associated with this text hyperlink which is invoked when 
the hyperlink is selected. An example of the command is 
HREF="http://../session.exe?REPLAY+vpc24+/a.dan+ 

55 TRUE+TRUE+FALSE+100" >Replay Session</a>. Vpc24 
is the machine name and the filename to be played is 
"a.dan". Options following the filename (i.e. a. dan) are: 
control looping (determines whether the presentation starts 
again at the beginning after reaching the end), autostart 

60 (determines whether the presentation starts automatically, or 
whether it is started manually (by clicking on a button)), 
speed (set faster or slower which is useful when preparing a 
presentation), and whether service should be destroyed at 
the end of playback. 

65 Next, at process block 2104, client Web browser 1312 
contacts HTTP server 1204, and at process block 2106, the 
HTTP server 1204 invokes the cgi-bin program session.exe. 
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In this case, the session.exe contacts appropriate director looping selected. If continuous looping was selected as an 

application 1306 through an RPC interface and requests that option, then at process block 2308, the file is restarted, 

the file be played at process block 2108. At process block Otherwise, at process block 2310, the session is ended and 

2110, director application 1306 returns a Web page contain- all resources are deleted. 

ing two frames. 5 If, however, at decision block 2304, it is not the end of the 

At process block 2112, client Web browser 1312 parses file, then at process block 2312, the director application 

the HTML and issues two new session requests 1306 sleeps until the next event (i.e. new frame layout, new 

(Session FramePresenta tion and URL is loaded into a frame, etc.) occurs. Next, director 

SessionFrameAppletCreate). Process blocks 2114-18 and application 1306 sends a LOAD command to piper server 

process blocks 2120-2128 occur simultaneously. Process 10 502 which loads a Web page at process block 2314. The 

blocks 2114-18 depict the steps for the SessionFramePre- event counter is incremented at process block 2316 and 

sentation which loads the frame contents in the presentation control is returned to process block 2302. 

frameset 902 and process blocks 2120-2128 depict the steps 3. Editing a Session 

for SessionFrameAppletCreate which loads the contents of Editing of a session can occur using the editor of director 

the frame which contains the client-side component 904. 15 application 1306. One illustrative embodiment of the editor 

Turning now to process block 2114, a GET QUERY is shown in the flow diagram of FIG. 24. The editor has a 

command is issued to HTTP server 1204 to fill the presen- GUI and contains timeline 2402 which graphically displays 

tation frameset 902. Next, at process block 2116, Session a plurality of time increments 2404 for the session being 

program 1302 is invoked returning the HTML describing the edited. Time increments 2404 are represented as vertical 

introductory Web page. The introductory Web page typically 20 fines in FIG. 24. Each time increment 2404 delineates a 

tells the client to "Please wait". Next, at process block 2118, point in time for the session. 

client Web browser 1312 renders a frame. Time interval 2406 (i.e. set interval of time) indicates that 

Simultaneously, at process block 2120, Session program a fixed number of time increments 2404 has transpired. 

1302 is passed the name of piper server 502 and the Here, time interval 2406 occurs every ten seconds of the 

SessionName. Next, at process block 2122, the Session 25 session and are numerically^designated-at-every "tenth" time 

program 1302 constructs a Web page that contains client- increment 2404 (i.e. at 0 seconds, the time interval 2406 is 

side component 904 and the HostName (name of piper represented as 0:00, at 10 seconds, the time is represented as 

server 502), and SessionName parameters. Next at process 0:10, etc.). Time intervals 2406 can be changed, for 

block 2124, client Web browser 1312 parses the HTML and example, to represent every five seconds of the session or 

issues a request to HTTP server 1204 to load client-side 30 any other arbitrary number. 

component 904. This is typically a GET QUERY command. Arrow 2408 indicates the current time. Random access to 

After client-side component 904 is downloaded at process a specific point of time in the session can be accomplished 

block 2126, it parses the parameters describing HostName by clicking on any time increment 2404 in timeline 2402, 

and SessionName. Client PC system 1208 connects to piper dragging the arrow 2408 to a particular time increment 2404 

server 502 using the same SessionName as director appli- 35 with a pointing device such as a mouse or using the buttons 

cation 1306. This is accomplished when client-side compo- (rewind button 2410, stop button 2412, and forward button 

nent 904 contacts appropriate piper server 502 and asks to 2414). 

join the named session at process block 2128. Below timeline 2402 are timeline contents 2416 which 

FIG. 22 depicts a flowchart of the steps director applica- comprises at least one content block. Each content block 

tion 1306 takes for replaying sessions. This is essentially an 40 classifies the frame layout and frame contents at particular 

explanation of the steps taken by director application 1306 time increment 2404 of the session. The introduction of a 

during process block 2108 in FIG. 21. new content block indicates that a new frame layout has 

At process block 2202, director application 1306 is started been introduced at corresponding time increment 2404. 

if it is not running. Next, at process block 2204, director In FIG. 24, there are two content blocks, content block 

application 1306 accepts the REPLAY Session RPC com- 45 2418 and content block 2420. Content block 2418 is intro- 

mand (using standard COM or DCOM). Then, at decision duced at 0:00 (0 seconds) on timeline 2402 and indicates that 

block 2206, director application 1306 determines if a file a frame layout was loaded at this time. Content block 2420 

exists with the selected file name and if the options are okay. is introduced at 0:10 (0 seconds) on timeline 2402 and 

If not, then an error code is returned to Session program indicates that a new frame layout has been introduced at this 

1302 at process block 2208. If yes, then at process block 50 time increment 2404. 

2210, director application 1306 loads the contents of the file Each content block contains at least one content display, 

name. Next, at process block 2212, a small window appears each content display having a corresponding content bar. 

with playback controls (control looping, autostart, speed, Each content display is a graphical representation of the 

and whether service should be destroyed at the end of frame layout and a particular frame in the frame layout is 

playback). 55 highlighted. The corresponding content bar contains at least 

Then, at process block 2214, piper server 502 is contacted one sub-content bar indicating the Internet Resources, Web 
and a request to construct a new session is issued. At pages, collaborative tools, etc. that are loaded in the high- 
decision block 2216, director application 1306 determines if lighted frame at a particular time increment 2404. The 
autostart has been selected. If yes, then at process block number of content displays in the content block is equivalent 
2218, the session clock is started. After the session clock is 60 to the number of frames in the graphical representation of 
started or if autostart is not selected, then a success code is the frame layout (i.e. if the frame layout contains three 
returned to Session program 1302 at process block 2220. frames, then there would be three content displays, each 

FIG. 23 shows a flowchart of the steps taken by director highlighting a different frame in the frame layout), 

application 1306 during the replaying process. At process Applying this to FIG. 24, content block 2418 contains one 

block 2302, the file is playing. At decision block 2304, it is 65 content display 2422 and its corresponding content bar 2424 

determined if it is the end of the file. If it.is, then at decision contains one sub-content bar. The content display 2422 

block 2306, it is determined if the file has the continuous indicates that the current frame layout contains one frame 
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and this frame is highlighted or selected. The content bar The basic editing actions supported by the editor are 
2424 contains one sub-content bar showing that a Web page inserting, moving, deleting, and copying framesets; 
having a URL address of http://bellcore.com/ inserting, moving, deleting, and copying URLs; and chang- 

beIlcore.pg4.html is loaded into the highlighted frame at in g the time of the end of the presentation. In addition the 

Umemcrement2404of0:05 rt 5 URL or filename contained in a sub-content bar can easily 

k ,1^^^ T 1 ; ' T ^T' 6 ? k t 2 ° be chan S cd ^ ^ in a new UR L or filename. The session 
Ll^ntn t h h 8 " Pr 3 mh T y ° ^ f can 1,6 cditcd 3 numbcr of W ^ s: individual frames or Web 

Sfion ^ s sy s mcre >* es can be moved b * c °p ied b y control 

There are two content displays (content display 2426 and dra Sf in S; deleted > and entirely new framesets can be 

content display 2428), one for each of the frames in the new 10 mserted from a menu * New resource ltems can * mserted 

frame layout 2420. Content display 2426 has a highlighted usm § the resource &oups located in Left-hand frame 2448. 

frame (i.e. the top frame) and the frame contents of the . ^ edltor can be used to enha nce a session containing a 

highlighted frame are depicted in the content bar 2430. simple videotape or audiotape with a variety of Internet 

Content display 2428 has a highlighted frame (i.e. the resources such as pictures and text. To accomplish this, 

bottom frame) and the frame contents of the highlighted 15 frames and Web pages can be associated with sound and 

frame are depicted in content bar 2432. video files. By associating a URL with a video or audio file, 

There are several sub-content bars located in content bar synchronization is maintained between the HTML still 

2430 indicating that the information in the frame has been frames and the video track or audio track, 

changed at various time increments 2404. For instance, 5. Piper server 502 

sub-content bar 2434 shows that the Web page having a URL 20 Piper server 502 acts as an intermediary between guide 

of http:Wwww.bellcore.com/bellcore/pgl.html was loaded system 1206 and client system 1208. In general, the guide 

into the highlighted frame at a time increment of 0:10. initiates instructions. These instructions are to load 

Sub-content bar 2436 indicates that the Web page having a framesets, frame layouts, and/or frame contents such as Web 

URL of http:Wwww.bellcore.com/bellcore/pg2.html was pages, collaborative tools and/or Internet Resources. These 

loaded into the highlighted frame at time increment of 0:24. 25 instructions are communicated to piper server 502. Piper 

There are only two sub-content bars located in content bar server 502 forward these instructions to all connected client 

2432, namely sub-content bar 2438 and sub-content bar systems through their client-side components. Each client - 

2440 which shows that the highlighted frame (i.e. bottom side component 904 orders its associated client Web browser 

frame) initially contains a Web page and then this Web page 1312 to implement the guide's instructions, 

is unloaded and a new Web page (having a URL of http:// 30 a. How changes to a Web page, frames within a Web 

www.saic.com) is loaded at time increment of 0:50. page, or a frame layout are implemented 

Situated below timeline contents 2416 are some sliders Turning now to FIG. 25, this is a flow diagram that depicts 

for controlling timeline parameters (position control 2442, the details of how changes to a Web page, frames within a 

zoom control 2444 and time control 2446). The position Web page, or a frame layout are implemented. First, at 

control 2442 which controls the window of the timeline 35 process block 2502, the guide changes a Web page, a frame 

shown on the screen. The zoom control 2444 enables the within a Web page, or a frame layout on his guide PC system 

timeline to be shown in further detail, lime control 2446 is 1206 using director application 1306. Next, at process block 

an alternative way to move indicia 2408 which shows the 2504, director application 1306 sends a URL for a new Web 

current time. page and address of the target frame to piper server 502. 

The lower half of the editor screen is divided into three 40 At this point, at decision block 2506, piper server 502 

frames, a left-hand frame 2448, center frame 2450, and a determines if it is a change to a frame or a change to a 

right-hand frame 2452. Left-hand frame 2448 contains frameset. If it is changed to a frameset, at process block 

resource groups, as previously described. Resource groups 2508, the new frame layout is saved. This information is 

contain the resource items that can be loaded into any of the used if a client joins a session already in progress. Finally, 

frames of a given frame layout. Thus, a guide can change the 45 at process block 2510, piper server 502 sends the URL and 

content of a frame at any given time increment 2404. For frame address to all clients, 

example, the guide can select a resource item such as 2. WGP Commands 

"AdaptX Rave" 2456 from the resource group called Main Piper server 502 communicates with director application 

Hamelin Links 2454. The pointer (URL, filename, etc.) to 1306 and client-side component 904 using WGP 1308. WGP 

the resource item can be substituted into the sub-content bar 50 1308 is built on top of TCP/IP. WGP 1308 is a simple 

2436 and at 0:24 of the session, the Web page, Internet string-based command language where strings are passed 

Resource, or collaborative tool that the pointer indicates will using the format specified in the Java string serialization 

be loaded into the frame. protocol. The commands in WGP 1308 include: JOINS (to 

Center frame 2450 contains current display 2458 (the join/start sessions), CREATE (to create a new session), and 

frame layout at time increment 2404 indicated by indicia 55 navigating commands such as LOAD and DROP. 

2408), time box 2460 (indicating numerically the current JOINS Command: The format of the JOINS command is 

time, i.e. the time increment pointed to by the indicia 2408), JOIN SessionName. An error number (errNum) or 0 (0 

preview box 2462 (switches on/off the browser in the means the command worked) is returned. Piper server 502 

right-hand frame 2452), and the browser button 2464 will additionally respond with a set of commands to syn- 

(causes an external browser to be spawned, and animations 60 chronize the clients' Web browser with the current frameset, 

played there). This is accomplished with a set of commands drawn from 

Right-hand frame 2452 has a browser for previewing the the navigating commands, 

contents of current display 2458 at the current time (i.e. time FIG. 26 is a flow diagram explaining the steps taken by 

indicated by indicia 2408 or time box 2460). As with any piper server 502 when the JOINS command is invoked, 

browser, individual frames of the frame layout can be 65 First, at process block 2602, the client loads a Web page that 

scrolled to further view the contents of the Web page or contains the client-side component 904 specifying the ses- 

Internet Resource. sion to join. Second, at process block 2604, the client-side 
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component contacts piper server 502 and issues a "JOINS" 
command specifying the SessionName. Third, at process 
block 2606 piper server 502 sends current frame layout and 
contents of all frames to the client(s). Fourth, at process 
block 2608 the client-side component 904 instructs its 5 
browser to load a frameset and all contained frames. 

CREATE command: The format of the CREATE com- 
mand is CREATE SessionName. The command creates a 
new session with the name SessionName. Piper server 502 
must ensure that this name is unique. The Sessionld is 10 
returned or -1 which indicates failure. Piper server 502 will 
additionally respond with a command to load a default 
starting Web page for the session. 

FIG. 27 is a flow diagram explaining the steps taken by 
piper server 502 when the CREATE command is invoked. At 15 
process block 2702, director application 1306 selects a new 
URL for a frame. Director application 1306 sends a com- 
mand "LOAD F R" to piper server 502 and shows the results 
in preview frame at process block 2704. Next, at process 
block 2706, piper server 502 sends "LOAD F R" command 20 
to all attached clients. At process block 2708, each client 
loads a resource into a selected frame. At process block 
2710, piper server 502 saves a copy of (F,R) for later clients. 

LOAD Command: Regarding the navigating commands, 
the guide or clients communicate these commands to piper 25 
server 502. Piper server 502 must forward these commands 
unchanged to all of the connected clients in a session. Piper 
server 502 must also save the currently displayed Web page 
in each frame and the current frame layout so that a client 
that joins an existing session can become synchronized in 30 
their Web page view with all the rest of the clients. 

One navigating command is LOAD and has the format of 
LOAD frame URL where frame is the name of the frame and 
the URL is the URL for any Internet resource. The LOAD 
command returns either an error number (errNum) or 0 35 
(indicating success). 

FIG. 28 is a flow diagram explaining the steps taken by 
piper server 502 when LOAD command is invoked. At 
process block 2802, director application 1306 selects a new 
frameset ("FSET"). Next, at process block 2804, director 40 
application 1306 sends a load command to piper server 502. 
At process block 2806, piper server 502 sends a load 
command to all attached clients. At process block 2808, each 
client issues an HTTP request to load its new frameset. 
Finally, at process block 2810, piper server 502 saves new 45 
current frame layout for later clients, and sets saved contents 
of new frames to blank. 

DROP Command: Another navigating command is the 
DROP command which returns either an error number 
(errNum) which indicates a failure or 0 which indicates a 50 
successful completion of the command. FIG. 29 is a flow 
diagram that depicts how a client leaves a session and the 
necessary steps taken to remove the client from the session 
using the DROP command. At process block 2902, the client 
leaves a Web page containing client-side component 904. 55 
Next, at process block 2904, client-side component "stop" 
method is called as the Web page is unloaded. The "stop" 
method is defined by Java for an applet. Client Web browser 
1312 calls the "stop" method when a Java applet is unloaded. 
The "stop method" issues a drop command to piper server 60 
502 at 2906. Piper server 502 deletes all resources associated 
with the client and closes the communication channel at 
process block 2908. Client-side component 904 closes the 
communication channel at process block 2910. 

Arbitrary Extension: WGP 1308 also supports arbitrary 65 
extension to allow the guides and clients to communicate. 
This is accomplished using a command set in which the type 
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of argument is pre -specified. The extension command set is 
initiated by sending an asterisk character. After the asterisk, 
a single integer specifies the number of parameters, and then 
a string comprised of the characters V and 'i' is used to 
specify strings and integers, respectively. Following the type 
specification, the parameters themselves are passed. For 
example: 
*3ssi 

Hello this is string one 
Hello this is string two 
23 

is a allowable use of the extensible part of the WGP 1308. 

Deleting a Session: Piper server 502 contains a Web- 
accessible administrative interface (i.e. the guide can com- 
municate with piper server 502 from any Web page) which 
allows the guide to delete a session, delete clients from 
sessions, list active sessions and list clients attached to 
particular sessions. 

FIG. 30 shows the steps taken by Session program 1302 
and piper server 502 to destroy a session. At process block 
3002, the client or guide selects (clicks) a link to terminate 
the session. Associated with the link is the encoded com- 
mand: session. exe?Killsession+HostName+SessionName. 
This command invokes Session program 1302 on HTTP 
server 1204 to destroy the session. The HostName (name of 
piper server 502) and SessionName (i.e. name of the 
session) are inputs to the session command. 

Next, at process block 3004, Session program 1302 
contacts piper server 502 and issues WGP 1308 command: 
Delete SessionName. The SessionName is a session object. 
Then at process block 3006, piper server 502 deletes all 
resources associated with the SessionName. In essence, 
piper server 502 maintains a reference count of clients, and 
removes all session resources (i.e. memory allocated, com- 
munication ports, data structures, etc.) when the count 
reaches zero. Piper server 502 can also forcibly disconnect 
all clients from a session when requested by the guide. 

Removing a client from a session 

Piper server 502 can also remove a client from a session 
as shown in FIG. 31. At process block 3102, the guide (or 
a system administrator) selects a link to remove the client 
from the session. Associated with the link is the encoded 
command: session.exe? Killclient+ HostName + 
SessionName+SessionlP+PortNumber. This command 
invokes Session program 1302 on HTTP server 1204 to 
remove the client from the session. The HostName and 
SessionName identify the session. SessionlP (machine name 
that the client is using) and PortNumber identify the client. 
All of these are inputs to the session command. 

Next, at process block 3104, Session program 1302 
contacts piper server 502 and WGP 1308 issues the appro- 
priate command to remove the client. Finally, at process 
block 3106, piper server 502 locates the client by 
IP_Address and Port Number and closes the communica- 
tions path for the client and deletes its sessions resources. 

Querying all active sessions 

Piper server 502 can also be queried for all active sessions 
as depicted in FIG. 32. This is because piper server 502 
maintains a database of sessions and keeps track of clients 
participating in the sessions. Referring now to FIG. 32, at 
process block 3202, the guide selects a link to list all active 
sessions on piper server 502. Associated with the link is the 
encoded command: session.exe?Enumerate+HostName. 
This command invokes Session program 1302 on HTTP 
server. The HostName (name of the piper server 502) is an 
input to the session command. Next, at process block 3204, 
Session program 1302 contacts piper server 502. 
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At process block 3206, piper server 502 returns a list of presently attached cUents; to allow an administrator to 

all sessions. Next, at process block 3208, Session program forcibly detach a client; and to delete itself when the number 

1302 can print out the sessions on the display screen or to a of clients reaches zero. 

printer as a list in HTML. FIG. 33 shows a sample printout There is one Session object per active session. Given a 

of the HTML for Active Piper Sessions produced by the 5 WeD page or frameset change generated by one of the 

process block 3208 of FIG. 32. There are two active connected clients, it forwards that change to all of the other 

sessions, entitled DEFAULT 3302 and PCHELP 3304. clients. One complication is that it must maintain a snapshot 

Each session has commands in HTML. The format of the of Wet> . P a S e and frame contents at all times. This is so 

command is HREF-"A"> — «B» — C where B is the text mat if a client J oins ^ tne middle of an active session, the 

for a link, A is the encoded command that is issued when link 10 clif ; nt . can immediately be given the current frame layout. 

B is selected, and C is HTML formatting information. For ^ ^.accomplished by recognizing the special frameset 

example, there is a command HREF="http7/ evocation command (i.e. MkFrameSet) and keeping a list or 

vpc24.beUcore.com/Hamelin/cgi-bin/session.exe?JOINS+ , map ° f * e cuirc ° t [ rame The Session object also 

PCHELP_vpc24_21655»>-^<JOIN>>-</a><a labeled ° f - the C L ™ ly client s (through 

1806. The information in brackets («JOIN») is the link IS ™A v T ^ k- . f u - r 

t L, f #k • „ i. n/ , v , ,/ . 1 here is a ClientConnection obiect for each active client 

Sen JOIM T«A £ hc ^ f™; ClientConnection object maintains TCP c^nec ions 
^ ' c ? miIiand ' h "P :// betweentheserverandeithercHent-sidecomponent904(ie 
IrutfZ ^ ™« ^/^f^^^^OmS + Rat applet or ActiveX control), director application 1306, 
PCHELP vpc24_21655 is issued. This activates Session and Session program 1302 (for system administration)! 
program 1302 to add a client to the session PCHELP. The 20 There are basically two modes of operation for the Client- 
links available are JOIN (to join a session), ACTIVE-RAT- Connection object: administrative mode (ClientConnection 
JOIN (enables a client to join a session that utilizes Active/X object is not associated with a Session and the connection is 
technology), LIST CLIENTS, and REMOVE SESSIONS. dropped at the end of the query or command) or client mode 
Piper server 502 can also be queried to list all clients for (ClientConnection object is maintained for the life of the 
a session as depicted in FIG. 34. At process block 3402, the 25 session or until the client disconnects or is forcibly 
guide clicks on a link requesting to list clients. Associated disconnected). When the ClientConnection object is in client 
with the link is the encoded command, mode, it listens for commands on the open TCP connection 
session.exe?LISTCLIENTS+HostName+SessionName and l yP icall y asks the Session of which it is a member to 
where LISTCLIENTS is the command that will be sent to forwa rd the command to all other members of the Session, 
piper server 502 using WGP 1308 with HostName and 30 - jLSJ? TCp Server object running in piper server 
SessionName as inputs. Next, at process block 3404 Ses- TCPServer waits for new clients, and constructs a 
sion program 1302 contacts piper server 502 and issues a D6W C f U ^ tC ?.^ ti0n ° bjeCt "V^P 0056 t0 an ^coming 
WGP command (Listclients SessionName) to list the clients T*** TCPServer u crea | es *e new session and creates 
in a particular session. At process block M06, piper server S^l^S ffi^T^ UDderet * nds the 
502 returns a list of clients to Session program 1302. Finally, 35 CREAI J S System ^ 

L^T^°£ I 34 ? S ™ Pr ° gram ^ rCtUniS 3 Client system 1208 is typically a PC system used by the 

formatted list of clients in HTML. client ^ components include client Web browser 

Join sessions in progress tf 12 an d client-side component 904. 

Piper server 502 enables clients to join sessions in Client Web browser 1312 is a browser (such as previously 

progress. For each session, piper server 502 saves the state 40 described in the Background of the Invention) which dis- 

of the current frameset and communicates the state to clients plays information (i.e. Web pages, Internet Resources, col- 

who join the middle of the session. This is because a client laborative tools, etc.) to the client. Client Web browser 1312 

joins a session which already has a frame layout, and the must be a Java-enabled browser (i.e. the browser is able to 

guide instructs client Web browser 1312 to load a URL into mn Java applets) such as Microsoft Internet Explorer or 

a particular frame, then the client Web browser 1312 will 45 Netscape Navigator. 

spawn a new window to contain that URL. ^ client-side component 904 is an applet, it communi- 

FIG. 35 illustrates the steps taken to join a session. At cates tne client WeD browser via an interface. The 

process block 3502, the client loads a Web page describing interface used for Java applets is AppletContext and the 

a Hamelin session by clicking on a Hamelin link. The appropriate format for the interface to be used by an applet 

underlying HTML associated with the link issues a 50 to obtain information about its environment is 

command, session.exe?FRAME+APPLET+JOIN. Next, at a.showdocument(URL, frame) where URL is the URL and 

process block 3504, client-side component 904 connects to frame is the target frame. 

piper server 502 specifying the SessionName. At process Client-side component 904 must support some or all of 

block 3506, piper server 502 locates the session. Piper server mese functions: 

502, at process block 3508, then sends a sequence of 55 1. Must respond to the WGP LOAD command, and be 

commands to load framesets and Web pages to client-side able to instruct its containing client Web browser 1312 

component 904 to synchronize the client's Web page with t0 replace the contents of the frame, or replace the main 

the guide. frame with a new frame layout. 

Internal Objects of piper server 2. Issue a WGP JOINS command when initially displayed 

Piper server 502 contains several internal objects which 60 in order to start participating in a session, 

include Session object, ClientConnection object, and TCPS- 3. Be able to instruct piper server 502 when the client 

erver object. The mam purpose of the Session object is to navigates the Web (i.e. clicks on a link) This is 

manage an array of clients and a count of the number of accomplished by the LOAD command if a new URL or 

clients; to forward a Web page or frame change notification a frame is changed. Client-side component 904 listens 

from one client to all others; to save the current frame layout 65 and when it sees a change notifies piper server 502 

and the contents of all the frames should a client join an Piper server 502 must use WGP 1308 to make these 

active session; to allow an administrator to query it for the notifications. 
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Client-side component 904 is typically an applet, phigin, 1312 to be the same window size. Alternatively, the pages 
or ActiveX control. It is required to interface with client Web should be authored with style-sheets or other strong format- 
browser 1312 and communicate with piper server 502. ting information which allows more control over the layout 
Client -side component 904 enables the guide to communi- and enables Web pages to look the same on any browser, 
cate commands to client Web browser 1312 via piper server 5 The shared pointer can be a pointing device overlaid on a 
502's WGP 1308. These commands are to change Web Web page in an unmodified browser that can be directed by 
pages, load Internet Resources, initiate collaborative tools, any remote participant (i.e. client). For example, the guide 
load framesets, change frame layouts, change frame via director application 1306 can construct a pointer over- 
contents, etc.. Client-side component 904 is contained in the lying the Web browsers of the guide and client(s). Either 
HTML of the Web page located on client Web browser 1312 10 party can "click on and drag" the pointer. If either party 
and electronically connects to piper server 502. moves it, it moves on all display screens for the PC systems 

If an applet is used as client-side component 904 (known (i.e. guide PC system(s) and client PC system(s)). 

as a Rat Applet), the Rat Applet listens on the TCP connec- WGP extensions needed to be added to provide the 

tion to piper server 502 for commands, and forwards com- functionality of the shared pointer. The following is a sample 

mands to load new Web pages to the client Web browser 15 of typical commands: POINTER ON (to make the pointer 

1312 (via the AppletCootext container class). It must also visible); POINTER OFF (to make the pointer invisible); 

tell piper server 502 when the Web page containing the POINTER COLOR (any color available in the spectrum 

applet is unloaded (by sending a drop command as previ- such as RED|GREEN|BLUE|PINK,PURPLE, and 

ously described in FIG. 29). YELLOW); and POINTER MOVE X,Y (to move 

Using a plugin rather than an applet as client-side com- 20 POINTER to position X,Y). 

ponent 904 leads to added functionality. This functionality FIGS. 36 and 37 show the actions taken by the compo- 

includes Frame Size Synchronization, Client Link nents of the Hamelin system when constructing/hiding the 

Notification, Shared pointer, and Shared whiteboard. Details pointer and moving the pointer respectively. With reference 

of some of the features are delineated below: to FIG. 36, at process block 3602, the guide selects a menu 

Frame Size Synchronization: This involves the determi- 25 item to show or hide pointer. Next, at process block 3604, 
nation of client Web browser size and position, which is director application 1306 shows or hides pointer. At process 
useful for annotations. The visual appearance of most Web block 3606, director sends WGP command "POINTER ON" 
pages depends upon the window size of the Web browser or "POINTER OFF" to piper server. At process block 3608, 
rendering it. When the guide need the exact appearance of piper server 502 sends a WGP command to each client. At 
client Web browser 1312, the window size of guide's 30 process block 3610, each client shows or hides the pointer, 
browser (i.e. the browser located in the local-view frame) With reference to FIG. 37, this exemplifies moving the 
can be synchronized to the window size of client Web pointer and the steps are repeated while the mouse button is 
browser 1312. This can be available through a menu, held down or any other activating mechanism occurs. At 
through a hot-key sequence (the ability to issue a command process block 3702, the guide (or client) clicks on the 
by issuing a keystroke (such as control-c) rather than using 35 pointer with the mouse and drags it. Next, at process block 
the mouse or menus), or director application 1306 can be set 3704, the local pointer moves with the mouse. Next, at 
to automatically trace changes in the window size of client process block 3706, guide (or client) sends WGP command: 
Web browser 1312. An audible indication of window size "POINTER MOVE X Y" where X,Y is the new position, 
changes can also be implemented. Next, at process block 3708, piper server 502 sends corn- 
Client link Navigation Notification: This includes client- 40 mand to all connected clients. Finally, at process block 3710, 
initiated navigation (i.e. notification when the client clicks each client (or guide) moves the pointer, 
on a link of a Web page), denial of client-initiated Shared Whiteboard: The guide can construct a collabo- 
navigation, and forwarding of client-initiated page changes rative tool such as a shared whiteboard that both the client 
to the guide (i.e. if the client chooses to follow a link, this and the guide can view on their browsers (i.e. remotely 
is communicated back to the guide so that the guide can 45 displayable frame 1010 of director application 1306 for the 
follow the client). Director application 1306 can be set to guide and client Web browser 1312 for the client). The 
automatically follow the client when the client follows the whiteboard can be enabled through a menu entry or 
selected links in client Web browser 1312. Director appli- alternatively, through a hot-key sequence. Any user of a 
cation 1306 can follow without asking, follow after asking, session can draw on his local copy of the displayed Web 
or not follow. The plugin itself can be set to deny requests 50 page and have his annotations appear to all of the other 
for client initiated navigation, forward these requests back to users. Typically for this feature to be useful, it is necessary 
director application 1306, or not inform director application for the Web browser in remotely displayable frame 1010 of 
1306 director application 1306 and the client Web browser 1312 

The client link navigation notification is implemented as to be the same size. Alternatively, the pages should be 

a blocking synchronous call or alternatively as a non- 55 authored with style-sheets or other strong formatting infor- 

blocking mechanism. mation which allows more control over the frame layout and 

Shared Pointer: The guide can construct a collaborative enables Web pages to look the same on any browser, 

tool such as a shared pointer that both the client and guide The shared whiteboard can be a method for supporting 

will view simultaneously on their Web browsers (i.e. freehand drawing on top of an existing Web page in an 

remotely displayable frame 1010 of director application 60 unmodified Web browser which many remote participants 

1306 for the guide and client Web browser 1312 for the (i.e. clients) can participate in the unique annotation. The 

client). The shared pointer is designed to allow parts of Web shared whiteboard can be constructed on top of the Web 

pages to be highlighted by any user of the session. It is browsers of the clients and guides. The guide can use the 

accessible through a menu entry, or through a hot-key whiteboard to mark up any underlying Web page, 

sequence. Typically for this feature to be useful, it is 65 WGP extensions needed to be added to provide the 

necessary for the browser in remotely displayable frame functionality of the shared whiteboard. The following is a 

1010 of director application 1306 and client Web browser sample of typical commands: WHITEBOARD ON (to acti- 
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vate the whiteboard; WHITEBOARD OFF (to deselect the 
whiteboard); and LINE COLOR, WIDTH NUMPOINTS 
X1Y1X2Y2X3Y3 . . . XNYN (to draw a line composed of 
NUMPOINTS straight sections of color (any color available 
in the spectrum such as RED, GREEN, BLUE, PINK, 5 
PURPLE, and YELLOW) of WIDTH "WIDTH" pixels. 

FIGS. 38 and 39 show the actions taken by the compo- 
nents of the Hamelin system when constructing/hiding the 
whiteboard and moving the whiteboard, respectively. With 
reference to FIG . 38, at process block 3802, the guide selects 
a menu item to show or hide the whiteboard. Next, at process 
block 3804, director application 1306 constructs the white- 
board (currently transparent) on top of the local -view frame. 
At process block 3806, director application 1306 sends 
WGP command "WHITEBOARD ON" or "WHITE- 
BOARD OFF" to piper server 502. At process block 3808, 15 
piper server 502 sends a WGP command to each attached 
client. Each client enables or displays the whiteboard, as 
evidenced by process block 3810. 

With reference to FIG. 39, movement of whiteboard is 
exemplified. At process block 3902, the guide (or client, as 20 
the case may be) clicks and drags the mouse to draw a line. 
Next, at process block 3904, whiteboard draws the line 
following the mouse pointer on top of the underlying Web 
page. When the mouse button is released at process block 
3906, director application 1306 or client-side component 25 
904 sends the WGP command: "LINE COLOR 3 N 
X1Y1X2Y2" to piper server 502 where color is the desired 
color for the display of the whiteboard. Next, at process 
block 3908, piper server 502 forwards the WGP command 
to all connected client systems. Finally, at process block 30 
3910, each client system draws the line segments on their 
respective Web browsers. 

While the invention has been described in detail in the 
foregoing description, it will be understood by those skilled 
in the art that variations may be made without departing 35 
from the spirit and scope of the invention. For example, the 
software components contained in HTTP Server 1204 and 
piper server 502 can be merged together into one hardware 
component typically known as HTTP/piper server without 
loss of functionality. As a second example, as more tools for 40 
the Web are developed, and applets, plugins, ActiveX 
controls, and other technology become more sophisticated, 
these Internet Resources can be integrated into the Hamelin 
system. 

As another example, consider application of the Hamelin 45 
system in an intranet environment rather than the Internet 
which has primarily been discussed. Web pages can be 
created using HTML that would be contain proprietary 
information. These Web pages could contain such Internet 
Resources as electronic catalogs containing product 50 
information, technical notes containing applications of 
products, and configurations of systems using company 
products, etc. A guide could construct a session giving a tour 
of new products and applications of those products. New 
employees and/or sales and marketing professionals can use 55 
these Web sites to learn new product information and 
applications for products. For example, in the test and 
measurement market, a salesperson or applications engineer 
could remotely logon to the company's intranet and thereby 
communicate with engineers or technicians when he has a 60 
problem installing a test and measurement system at a 
customer's site. Thus, as shown, the invention has applica- 
tion in any computer network whether it be a LAN, WAN, 
Internet, intranet or extranet. 
What is claimed is: 65 
1. A method for communicating between a guide system 
and a client system interconnected via a browser-based 
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network, the client system deploying a conventional 
browser, the method comprising the steps of 

configuring the guide system with a special-purpose 
browser containing both a locally displayable frame 
layout for displaying local frames and a guide config- 
urable remotely displayable frame layout for displaying 
remote frames, 

under the control of a guide, selectively defining each 
frame of the remotely displayable frame layout, an 

under the control of the guide, propagating the remotely 
displayable frame layout and frames over the network 
to the client system for display by the conventional 
browser of the client system. 

2. The method as recited in claim 1 wherein the step of 
configuring includes the step of loading the guide system 
with a set of predefined frame layouts, and the method 
further includes the step, prior to the step of propagating, of 
selecting by the guide one of the predefined frame layouts to 
display remotely displayable frames. 

3. The method as recited in claim 2 further including the 
steps of 

in response to a request from a client as propagated over 
the network, changing at least one of the remotely 
displayable frames as chosen by the guide, and 

under control of the guide, re-propagating only said at 
least one of the remotely displayable frames over the 
network to the client system for display by the con- 
ventional browser of the client system. 

4. The method as recited in claim 1 further including the 
step of synchronizing the special-purpose browser with the 
conventional browser via the network so that scrolling by 
the guide on any of the remotely displayable frames is 
displayed on the client system. 

5. The method as recited in claim 4 wherein said step of 
synchronizing includes the step of synchronizing the con- 
ventional browser with the special-purpose browser via the 
network so that scrolling by the client on any of the remotely 
displayable frames viewable by the client is also displayed 
on the guide system. 

6. A method for communicating between a guide system 
and a client system interconnected via a browser-based 
network, the client system deploying a conventional 
browser, the method comprising the steps of 

configuring the guide system with a special-purpose 
browser for displaying both locally displayable frames 
and remotely displayable frames on the guide system, 

under control of a guide, propagating the remotely dis- 
playable frames over the network to the client system 
for display by the conventional browser of the client 
system, 

configuring both the guide system and the client system 
with jointly operational shared pointer software, and 

executing the shared pointer software to control a shared 
pointer displayable concurrently on the conventional 
browser and on one of the remotely displayable frames 
of the special purpose browser. 

7. A method for communicating between a guide system 
and a client system interconnected via a browser-based 
network, the client system deploying a conventional 
browser, the method comprising the steps of 

configuring the guide system with a special-purpose 
browser for displaying both locally displayable frames 
and remotely displayable frames on the guide system, 

under control of a guide, propagating the remotely dis- 
playable frames over the network to the client system 
for display by the conventional browser of the client 
system, 
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configuring both the guide system and the client system 
with jointly operational whiteboard software, and 

executing the whiteboard software to control whiteboard 
markings displayable concurrently on the conventional 
browser and on one of the remotely displayable frames 5 
of the special purpose browser. 

8. A method for communicating between a guide system 
and a client system interconnected via a browser-based 
network, the client system deploying a conventional 
browser, the method comprising the steps of 10 

configuring the guide system with a special-purpose 
browser for displaying both locally displayable frames 
and remotely displayable frames on the guide system, 

under control of a guide, propagating the remotely dis- 
playable frames over the network to the client system 
for display by the conventional browser of the client 
system, 

configuring both the guide system and the client system 
with jointly operational free-hand drawing software, 2 o 
and 

executing the drawing software to control free-hand draw- 
ing markings displayable concurrently on the conven- 
tional browser and on one of the remotely displayable 
frames of the special purpose browser. 25 

9. The method as recited in claim 1 further comprising the 
steps of 

configuring both the guide system and the client system 
administration software for identifying the client 
system, and 30 

executing the administration software to provide the iden- 
tity of the client system to the guide system as rendered 
on its special purpose browser. 

10. The method as recited in claim 1 further comprising 
the steps of 

configuring both the guide system and the client system 
with administration software for disconnecting the cli- 
ent system from the guide system, and 

executing the administration software to disconnect the 4 q 
client system under control of the guide system. 

11. The method as recited in claim 1 further comprising 
the steps of 

configuring the guide system with recording software to 
allow the guide, while using the guide system off-line, 45 
to record a list of event and event times, and 

executing the recording software to record the list of 
events and event times. 

12. The method as recited in claim 11 further comprising 
the steps of 50 

configuring the guide system with playback software for 
playing back the recorded list of events per the event 
times, and 

executing the playback software, under the control of 55 
either the guide or client, for displaying the recorded 
list of events on the remotely displayable frames of the 
client's conventional browser. 

13. The method as recited in claim 11 further comprising 
the steps of 

configuring the guide system with editing software for 
editing the recorded list of events and event times, and 

executing the editing software, under the control of the 
guide, to edit the recorded list of events and event 
times. 65 

14. A method for communicating between a guide system 
and a client system over a browser-based network, the client 
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system deploying a conventional browser, the method com- 
prising the steps of 

configuring the guide system with a special-purpose 
browser containing both a locally displayable frame 
layout for displaying local frames and a guide config- 
urable remotely displayable frame layout for displaying 
remote frames, 

interconnecting the guide system and the client system 
over the network in response to a request by a client, 

defining the frames of the remotely displayable frame 
layout under control of a guide in response to the 
request by the client, and 

propagating only the remotely displayable frame layout 
and frames over the network to the client system for 
display by the conventional browser of the client sys- 
tem. 

15. The method as recited in claim 14 wherein the step of 
configuring the guide system includes the step of pre- 
loading the frames of the locally displayable frame layout 
with resource items commonly used by the guide. 

16. The method as recited in claim 15 wherein the step of 
defining includes the step of defining at least one of the 
remotely displayable frames with a commonly use resource 
item. 

17. The method as recited in claim 14 wherein the step of 
defining includes the steps of 

choosing by the guide for display in one of the locally 
displayable frames a predefined frameset, and 

loading the remotely displayable frame layout with the 
frameset as displayed in the said one of the locally 
displayable frames. 

18. The method as recited in claim 14 wherein the step of 
defining includes the steps of 

choosing by the guide for display in one of the locally 
displayable frames a Web page accessible via the 
network, and 

loading at least one of the remotely displayable frames 
with the Web page as displayed in the said one of the 
locally displayable frames. 

19. A method for communicating between a guide system 
and a client system over a browser-based network, the client 
system deploying a conventional browser, the method com- 
prising the steps of 

configuring the guide system with a special-purpose 
browser for displaying both locally displayable frames 
and remotely displayable frames on the guide system, 

interconnecting the guide system and the client system 
over the network in response to a request by a client 

selecting the remotely displayable frames under control of 
a guide in response to the request by the client, 

propagating only the remotely displayable frames over the 
network to the client system for display by the con- 
ventional browser of the client system, 

configuring both the guide system and the client system 
with jointly operational whiteboard software, and 

executing the whiteboard software to control whiteboard 
markings displayable concurrently on the conventional 
browser and on one of the remotely displayable frames 
of the special purpose browser. 

20. A system for communicating between a guide system 
and a client system interconnected via a browser-based 
network, the client system deploying a conventional 
browser, the system comprising 

configuration means for configuring the guide system 
with a special-purpose browser containing both a 
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locally displayable frame layout for displaying local 
frames and a guide configurable remotely displayable 
frame layout of displaying remote frames, 
configuration means, under the control of a guide, for 
selectively defining each frame of the remotely dis- 
playable frame layout, and 
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communication means, under the control of the guide, for 
propagating the remotely displayable frame layout and 
frames over the network to the client system for display 
by the conventional browser of the client system. 
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